Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
AlloyingotneoyExperiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
690104a
AlloyingotneoyExperiment26-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
77dfb41b4c9672f8d2f79065ea94e8aa228d2ce6bb1aeecf358724182c4c384e
690104a
verified
6 months ago
.gitattributes
2.3 kB
77dfb41b4c9672f8d2f79065ea94e8aa228d2ce6bb1aeecf358724182c4c384e
6 months ago
AlloyingotneoyExperiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
93229eb1b9178565555ffbcbe5c59e1ecf86f49e9302f7eadce2aa7665893845
6 months ago
AlloyingotneoyExperiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
a263abfa79b591d74d1a9865479338b4b558a12a7563751eb76ad85b7ead1284
6 months ago
AlloyingotneoyExperiment26-7B.Q2_K.gguf
2.72 GB
LFS
ed1743a16239434dba52f30ffd5102af8fcae93897f9e2b8020ba4b8958e564b
6 months ago
AlloyingotneoyExperiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
9beca1faae51355b0b1d2d7d6f2c9db5fead67eac249888ffdca7f64176f2eec
6 months ago
AlloyingotneoyExperiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
d7a847c70b6fb8e0f9a37a97fc555a00742ac5e41babe2ff7d3fcccfccaa9eaa
6 months ago
AlloyingotneoyExperiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
9e449c2fb9268e8287609cf34925ceba8e6a8a0d6d013cae1f40cfed80792f92
6 months ago
AlloyingotneoyExperiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
9fb7c614c0bbf9b3e70c1324ee3add18187c535402db15103e907ed7d87a7ab1
6 months ago
AlloyingotneoyExperiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
19de90ab56455915b1de999b75f50f8763917f82ade0c841cdda7dd2b7e2a184
6 months ago
AlloyingotneoyExperiment26-7B.Q5_K_M.gguf
5.13 GB
LFS
c51a5121dc1e05b4b6d0f272bc6c9692423effb7bea7ba67195a8133e51392f9
6 months ago
AlloyingotneoyExperiment26-7B.Q5_K_S.gguf
5 GB
LFS
77dfb41b4c9672f8d2f79065ea94e8aa228d2ce6bb1aeecf358724182c4c384e
6 months ago
