Are there tensorflow lite versions of the Phi3 models?

#5
by Zhubarb - opened

I understand there are onnx and gguf versions of the model. I was wondering whether tensorflow lite is also supported?

Microsoft org

TensorFlow Lite (TFLite) is not guaranteed to work with these uploaded ONNX models. These models are optimized for ONNX Runtime (ORT) and converting these ONNX models to TFLite may fail due to the ORT-specific operators in the model.

You can try these steps to convert the uploaded ONNX models to TFLite. If those steps fail, you can try exporting the original PyTorch model to ONNX and convert that ONNX model to TFLite. However, the resulting ONNX model will not be optimized.

kvaishnavi changed discussion status to closed

I'm also interesting about tflite phi3 model.
Did you try the solution or it just not working?

Sign up or log in to comment