File size: 721 Bytes
cc8ca3e
 
 
495523b
16f3dac
 
 
 
 
ddd6f10
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16f3dac
 
495523b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
license: apache-2.0
---

Frankenmerge 11b between HuggingFaceH4/zephyr-7b-beta and Intel/neural-chat-7b-v3-1

Merge with the following conditions (via mergekit on github)


      model: Intel/neural-chat-7b-v3-1
      layer_range: [0, 8]
      
      model: HuggingFaceH4/zephyr-7b-beta
      layer_range: [4, 12]
      
      model: Intel/neural-chat-7b-v3-1
      layer_range: [9, 16]
      
      model: HuggingFaceH4/zephyr-7b-beta
      layer_range: [13, 20]
      
      model: Intel/neural-chat-7b-v3-1
      layer_range: [17, 24]
      
      model: HuggingFaceH4/zephyr-7b-beta
      layer_range: [21, 28]
      
      model: Intel/neural-chat-7b-v3-1
      layer_range: [25, 32]

merge_method: passthrough