Commit
•
24965b6
1
Parent(s):
16a52c8
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Chinese-CodeLlama-7B-SFT-V2
|
| 2 |
+
|
| 3 |
+
We added 7k+ Python code instructions and implemented SFT based on our [Chinese-CodeLlama-7B-SFT-V1](https://huggingface.co/frankminors123/Chinese-CodeLlama-7B-SFT-V1). Drawing on the work of [code-llama](https://ai.meta.com/research/publications/code-llama-open-foundation-models-for-code/), we increased
|
| 4 |
+
the base period $\theta$ of rotary positional embeddings (RoPE) from 10000 to 1000000.
|