mlx-community
/

dbrx-instruct-4bit

eek commited on Mar 29

Commit

133785d

•

1 Parent(s): 913dd97

Update: Change URL to model in Readme

Files changed (1) hide show

README.md CHANGED Viewed

@@ -75,7 +75,7 @@ If `<|im_start|>assistant` is not added, an error will appear.
 You can add the above in a text file and use it as:
 ```bash
-python -m mlx_lm.generate --model dbrx-instruct-4bit --prompt "$(cat my_prompt.txt)"  --trust-remote-code --max-tokens 1000
 ```
 Output:
@@ -99,7 +99,7 @@ To use it from Python you can do the following:
 from mlx_lm import load, generate
 model, tokenizer = load(
-   "/Users/eek/work/dbrx-instruct-4bit/",
    tokenizer_config={"trust_remote_code": True}
 )

 You can add the above in a text file and use it as:
 ```bash
+python -m mlx_lm.generate --model mlx-community/dbrx-instruct-4bit --prompt "$(cat my_prompt.txt)"  --trust-remote-code --max-tokens 1000
 ```
 Output:
 from mlx_lm import load, generate
 model, tokenizer = load(
+   "mlx-community/dbrx-instruct-4bit",
    tokenizer_config={"trust_remote_code": True}
 )