uw-madison
/

Llama2-7B-FrameQuant-2bit

Model card Files Files and versions Community

Edit model card

This is a 2-bit quantized Llama2-7B model using FrameQuant. Use the inference script at https://github.com/vsingh-group/FrameQuant to run the model.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .