MaziyarPanahi
/

Llama-3-8B-Instruct-DPO-v0.2

Text Generation

text-generation-inference

Model card Files Files and versions Community

MaziyarPanahi commited on Apr 23

Commit

413e4ed

•

1 Parent(s): 9858658

fix the dataset used

Files changed (1) hide show

README.md +2 -3

README.md CHANGED Viewed

@@ -20,7 +20,7 @@ model_creator: MaziyarPanahi
 model_name: Llama-3-8B-Instruct-DPO-v0.2
 quantized_by: MaziyarPanahi
 datasets:
-- mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha
 ---
 <img src="./llama-3-merges.webp" alt="Llama-3 DPO Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
@@ -92,5 +92,4 @@ outputs = pipeline(
     top_p=0.95,
 )
 print(outputs[0]["generated_text"][len(prompt):])
-```

 model_name: Llama-3-8B-Instruct-DPO-v0.2
 quantized_by: MaziyarPanahi
 datasets:
+- argilla/ultrafeedback-binarized-preferences
 ---
 <img src="./llama-3-merges.webp" alt="Llama-3 DPO Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
     top_p=0.95,
 )
 print(outputs[0]["generated_text"][len(prompt):])
+```