jpacifico commited on
Commit
a729659
1 Parent(s): c8dc87f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -40
README.md CHANGED
@@ -12,49 +12,21 @@ tags:
12
  - french
13
  - chocolatine
14
  - llama-cpp
15
- - gguf-my-repo
16
  ---
17
 
18
- # jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF
19
- This model was converted to GGUF format from [`jpacifico/Chocolatine-3B-Instruct-DPO-Revised`](https://huggingface.co/jpacifico/Chocolatine-3B-Instruct-DPO-Revised) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
20
- Refer to the [original model card](https://huggingface.co/jpacifico/Chocolatine-3B-Instruct-DPO-Revised) for more details on the model.
 
 
21
 
22
- ## Use with llama.cpp
23
- Install llama.cpp through brew (works on Mac and Linux)
24
 
25
- ```bash
26
- brew install llama.cpp
27
 
28
- ```
29
- Invoke the llama.cpp server or the CLI.
30
 
31
- ### CLI:
32
- ```bash
33
- llama-cli --hf-repo jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF --hf-file chocolatine-3b-instruct-dpo-revised-q4_k_m.gguf -p "The meaning to life and the universe is"
34
- ```
35
-
36
- ### Server:
37
- ```bash
38
- llama-server --hf-repo jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF --hf-file chocolatine-3b-instruct-dpo-revised-q4_k_m.gguf -c 2048
39
- ```
40
-
41
- Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
42
-
43
- Step 1: Clone llama.cpp from GitHub.
44
- ```
45
- git clone https://github.com/ggerganov/llama.cpp
46
- ```
47
-
48
- Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
49
- ```
50
- cd llama.cpp && LLAMA_CURL=1 make
51
- ```
52
-
53
- Step 3: Run inference through the main binary.
54
- ```
55
- ./llama-cli --hf-repo jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF --hf-file chocolatine-3b-instruct-dpo-revised-q4_k_m.gguf -p "The meaning to life and the universe is"
56
- ```
57
- or
58
- ```
59
- ./llama-server --hf-repo jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF --hf-file chocolatine-3b-instruct-dpo-revised-q4_k_m.gguf -c 2048
60
- ```
 
12
  - french
13
  - chocolatine
14
  - llama-cpp
 
15
  ---
16
 
17
+ # Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF
18
+ Quantized q4_k_m GGUF version of the original model [`Chocolatine-3B-Instruct-DPO-Revised`](https://huggingface.co/jpacifico/Chocolatine-3B-Instruct-DPO-Revised)
19
+ can be used on a CPU device, compatible llama.cpp,
20
+ now supported architecture by LM Studio.
21
+ Also ready for Raspberry Pi 5 8Gb.
22
 
 
 
23
 
24
+ ### Limitations
 
25
 
26
+ The Chocolatine model is a quick demonstration that a base model can be easily fine-tuned to achieve compelling performance.
27
+ It does not have any moderation mechanism.
28
 
29
+ - **Developed by:** Jonathan Pacifico, 2024
30
+ - **Model type:** LLM
31
+ - **Language(s) (NLP):** French, English
32
+ - **License:** MIT