license: apache-2.0 | |
tags: | |
- merge | |
- mergekit | |
- vortexmergekit | |
- Kukedlc/NeuralSirKrishna-7b | |
- WizardLM/WizardMath-7B-V1.1 | |
# NeuralKrishnaMathWizard-7B | |
Hey there! π Welcome to the NeuralKrishnaMathWizard-7B! This is a merge of multiple models brought together using the awesome [VortexMerge kit](https://colab.research.google.com/drive/1YjcvCLuNG1PK7Le6_4xhVU5VpzTwvGhk#scrollTo=UG5H2TK4gVyl). | |
Let's see what we've got in this merge: | |
* [Kukedlc/NeuralSirKrishna-7b](https://huggingface.co/Kukedlc/NeuralSirKrishna-7b) π | |
* [WizardLM/WizardMath-7B-V1.1](https://huggingface.co/WizardLM/WizardMath-7B-V1.1) π | |
## 𧩠Configuration | |
```yaml | |
models: | |
- model: Kukedlc/NeuralSirKrishna-7b | |
parameters: | |
density: 0.9 | |
weight: 0.5 | |
- model: WizardLM/WizardMath-7B-V1.1 | |
parameters: | |
density: 0.5 | |
weight: 0.5 | |
merge_method: ties | |
base_model: Kukedlc/NeuralSirKrishna-7b | |
parameters: | |
normalize: true | |
int8_mask: true | |
dtype: float16 | |