Tutorial to run microsoft/Phi-3-medium-128k-instruct-onnx-directml

#1
by Neuronspark - opened

observing an error :runtime error opening genai_config.json

Microsoft org

You can download the ONNX model with

huggingface-cli download microsoft/Phi-3-medium-128k-instruct-onnx-directml --include directml-int4-awq-block-128/* --local-dir .

and then follow the example Phi-3 tutorial here.

kvaishnavi changed discussion status to closed

Sign up or log in to comment