Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
instructlab
/
granite-7b-lab-GGUF
like
23
Transformers
GGUF
English
llama
granite
ibm
lab
labrador
labradorite
text-generation-inference
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
Edit model card
Granite 7b - GGUF
Granite 7b - GGUF
4-bit quantized version of
instructlab/granite-7b-lab
Downloads last month
3,632
GGUF
Model size
6.74B params
Architecture
llama
4-bit
Q4_K_M
Inference API
Unable to determine this model’s pipeline type. Check the
docs
.
Model tree for
instructlab/granite-7b-lab-GGUF
Base model
ibm-granite/granite-7b-base
Finetuned
instructlab/granite-7b-lab
Quantized
this model