Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qT3qm7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
T3qT3qm7-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
f8749d03d8ad3a7e4ec60be4f775e57259284c53930ce29d293d68fd877eb5ce
b128de4
verified
6 months ago
.gitattributes
2.18 kB
d3448ad112cb2920cab6699a54b1d4f1047542b99870e73cc2aa0a41c6028eb9
6 months ago
README.md
10.8 kB
f8749d03d8ad3a7e4ec60be4f775e57259284c53930ce29d293d68fd877eb5ce
6 months ago
T3qT3qm7-7B.IQ3_XS.gguf
3.02 GB
LFS
4cb6b987a78ad0f7d4dc23e7319bfb8cf5d1c495abb5622a94de08bea664254e
6 months ago
T3qT3qm7-7B.IQ4_XS.gguf
3.94 GB
LFS
62f17f21210cb7ee1fd556d94402889ab9439a8dd55ff788e856513bec254792
6 months ago
T3qT3qm7-7B.Q2_K.gguf
2.72 GB
LFS
7ed977bf7856da6187b3d141d1b05f9ad30784029ee435fcab9d0ec2a1515292
6 months ago
T3qT3qm7-7B.Q3_K_L.gguf
3.82 GB
LFS
e15fea4a89eeb6e8fca58464df1f0a4faf73ad6cbcd03eb73b155b64f36af4e3
6 months ago
T3qT3qm7-7B.Q3_K_M.gguf
3.52 GB
LFS
2e140139e1f19ba8892c9dd06d386c559df591592cd844a9ba56cad6ecf59704
6 months ago
T3qT3qm7-7B.Q3_K_S.gguf
3.16 GB
LFS
eb5e37755c7e8db159f32d1b25ff4d661aa0a8f36501212d74cbe7fe8e528233
6 months ago
T3qT3qm7-7B.Q4_K_M.gguf
4.37 GB
LFS
95f5eccbf549b805ce0bd328f01898deb2f676d96c1d6524ddd64ae52a6be407
6 months ago
T3qT3qm7-7B.Q4_K_S.gguf
4.14 GB
LFS
b84fdd94d0c457873aa9e86d735cc225c6f0a26da9d6bd77f911c5a94d96105b
6 months ago
T3qT3qm7-7B.Q5_K_M.gguf
5.13 GB
LFS
3f6d2fdfd416528076da10aeecc0cfce12a56ce454fffe422f4a7baf044f2dd1
6 months ago
T3qT3qm7-7B.Q5_K_S.gguf
5 GB
LFS
057a9a7cae866ddeb1886fbb58c3416fbf9b7933d18c7f829a943a7ed9540e97
6 months ago
T3qT3qm7-7B.Q6_K.gguf
5.94 GB
LFS
d3448ad112cb2920cab6699a54b1d4f1047542b99870e73cc2aa0a41c6028eb9
6 months ago
