thevox commited on
Commit
b3c9293
1 Parent(s): c311c3d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -35,7 +35,7 @@ This model was trained using [H2O LLM Studio](https://github.com/h2oai/h2o-llmst
35
 
36
  Trained in 4-Bit with Lora (R=64) for 2 epochs. Perplexity on validation: 1.245
37
 
38
- Hardware: 1x A100 80GB for 12 hours
39
 
40
  ## Usage
41
 
@@ -46,6 +46,10 @@ Recommended prompt format:
46
  </s><|answer|>
47
  ```
48
 
 
 
 
 
49
  ### Code
50
 
51
  To use the model with the `transformers` library on a machine with GPUs, first make sure you have the `transformers` library installed.
 
35
 
36
  Trained in 4-Bit with Lora (R=64) for 2 epochs. Perplexity on validation: 1.245
37
 
38
+ **Hardware**: 1x A100 80GB for 12 hours
39
 
40
  ## Usage
41
 
 
46
  </s><|answer|>
47
  ```
48
 
49
+ ### Inference
50
+
51
+ Recommended to use 2-4 beams when generating.
52
+
53
  ### Code
54
 
55
  To use the model with the `transformers` library on a machine with GPUs, first make sure you have the `transformers` library installed.