Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
WizardLM/WizardMath-7B-V1.1
en
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
Inference Endpoints