Aspik101 commited on
Commit
22686ed
1 Parent(s): 2c56bef

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - pl
4
+ license: other
5
+ model_type: llama-2
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - facebook
9
+ - meta
10
+ - pytorch
11
+ - llama
12
+ - llama-2
13
+ - voicelab
14
+ ---
15
+
16
+ #### Description
17
+
18
+ GGML Format model files for [This project](https://huggingface.co/Voicelab/trurl-2-7b).
19
+
20
+
21
+ ### inference
22
+
23
+ ```python
24
+ import ctransformers
25
+ from ctransformers import AutoModelForCausalLM
26
+
27
+ model = AutoModelForCausalLM.from_pretrained("Aspik101/trurl-2-7b-GGML",model_type="llama")
28
+
29
+ prompt = "Yesterday, when I was"
30
+ llm(prompt_input,
31
+ max_new_tokens=256,
32
+ temperature=0.9,
33
+ top_p= 0.7)
34
+
35
+ ```