tyoyo commited on
Commit
ad90505
1 Parent(s): 9d15bc4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - llama-cpp
5
+ ---
6
+
7
+ # Llama-3-ELYZA-JP-8B-GGUF
8
+
9
+ ## Use with llama.cpp
10
+ Install llama.cpp through brew (works on Mac and Linux)
11
+
12
+ ```bash
13
+ brew install llama.cpp
14
+ ```
15
+ Invoke the llama.cpp server or the CLI.
16
+
17
+ ### CLI:
18
+ ```bash
19
+ llama --hf-repo elyza/Llama-3-ELYZA-JP-8B-GGUF --hf-file Llama-3-ELYZA-JP-8B-q4_k_m.gguf -p "古代ギリシャを学ぶ上で知っておくべきポイントは?"
20
+ ```
21
+
22
+ ### Server:
23
+ ```bash
24
+ llama-server --hf-repo elyza/Llama-3-ELYZA-JP-8B-GGUF --hf-file Llama-3-ELYZA-JP-8B-q4_k_m.gguf -c 2048
25
+ ```