gbueno86 commited on
Commit
af59d46
1 Parent(s): eb0e5de

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +188 -3
README.md CHANGED
@@ -1,3 +1,188 @@
1
- ---
2
- license: llama3
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/649dc85249ae3a68334adcc6/q3MkfQNU9gAw8Bn-OHHpK.jpeg)
2
+
3
+ ---
4
+ base_model: []
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # merged
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the passthrough merge method.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * https://huggingface.co/Undi95/Meta-Llama-3-70B-Instruct-hf
24
+ * https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+ slices:
32
+ - sources:
33
+ - layer_range: [0, 20]
34
+ model: /mnt/data/models/Undi95_Meta-Llama-3-70B-Instruct-hf
35
+ - sources:
36
+ - layer_range: [10, 30]
37
+ model: /mnt/data/models/turboderp_Cat-Llama-3-70B-instruct
38
+ - sources:
39
+ - layer_range: [20, 40]
40
+ model: /mnt/data/models/Undi95_Meta-Llama-3-70B-Instruct-hf
41
+ - sources:
42
+ - layer_range: [30, 50]
43
+ model: /mnt/data/models/turboderp_Cat-Llama-3-70B-instruct
44
+ - sources:
45
+ - layer_range: [40, 60]
46
+ model: /mnt/data/models/Undi95_Meta-Llama-3-70B-Instruct-hf
47
+ - sources:
48
+ - layer_range: [50, 70]
49
+ model: /mnt/data/models/turboderp_Cat-Llama-3-70B-instruct
50
+ - sources:
51
+ - layer_range: [60, 80]
52
+ model: /mnt/data/models/Undi95_Meta-Llama-3-70B-Instruct-hf
53
+ merge_method: passthrough
54
+ dtype: bfloat16
55
+ ```
56
+
57
+ Generation examples:
58
+
59
+ ```text
60
+ File: llama_cat_merge.Q4_K_M.gguf
61
+ Temperature
62
+ 0.9
63
+ Penalize repeat sequence
64
+ 1
65
+ Consider N tokens for penalize
66
+ 256
67
+ Penalize repetition of newlines
68
+ Top-K sampling
69
+ 40
70
+ Top-P sampling
71
+ 0.9
72
+ Min-P sampling
73
+ 0.05
74
+ ```
75
+
76
+ ```text
77
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
78
+
79
+ <|eot_id|><|start_header_id|>user<|end_header_id|>
80
+ Maria has 3 brothers. Each brother has 2 sisters. How many sisters does Maria have?
81
+
82
+ <|eot_id|><|start_header_id|>assistant<|end_header_id|>
83
+
84
+ Let's break it down step by step:
85
+
86
+ 1. Maria has 3 brothers. (This is given in the problem.)
87
+ 2. Each brother has 2 sisters. (This is also given in the problem.)
88
+
89
+ Now, let's think about it:
90
+
91
+ * Brother 1 has 2 sisters: Maria (because she is his sister) and another sister (let's call her Sister X).
92
+ * Brother 2 has 2 sisters: Maria (because she is his sister too) and another sister. Wait, we already counted this sister as Sister X (from Brother 1's count).
93
+ * Brother 3 has 2 sisters: Maria (because she is his sister too) and another sister. Again, we already counted this sister as Sister X (from Brother 1's and Brother 2's count).
94
+
95
+ Do you see the pattern? Every time we count the sisters for each brother, we are counting Maria and Sister X. But we don't want to count Maria as a sister to herself, right? So, we only count Sister X as Maria's sister.
96
+
97
+ Therefore, Maria has 1 sister (Sister X).
98
+ ```
99
+
100
+ ```text
101
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
102
+
103
+ <|eot_id|><|start_header_id|>user<|end_header_id|>
104
+ There are 7 killers in a room. A person enters the room and kills a killer. How many killers are there in the room?
105
+
106
+ <|eot_id|><|start_header_id|>assistant<|end_header_id|>
107
+
108
+ A classic lateral thinking puzzle!
109
+
110
+ When a person enters the room, there are 7 killers (already present) + 1 (the person who just entered) = 8 people in the room.
111
+
112
+ The person who just entered the room kills a killer (one of the original 7). Now, there are 7 killers - 1 (the one who got killed) = 6 killers left from the original 7.
113
+
114
+ However, we must not forget that the person who just entered the room and killed someone also becomes a killer. So, there are 6 (original killers left) + 1 (the person who just entered and killed) = 7 killers in the room.
115
+
116
+ The correct answer is still 7 killers in the room!
117
+ ```
118
+
119
+ ```text
120
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
121
+
122
+ <|eot_id|><|start_header_id|>user<|end_header_id|>
123
+ You are trapped in a room with two doors. One leads to a room with a convex mirror that reflects sunlight focused on the door, so as soon as you open the door, the focused light will burn you alive. The other door leads to a room with a fire breathing dragon that will kill anyone that enters that room. How do you escape?
124
+
125
+ <|eot_id|><|start_header_id|>assistant<|end_header_id|>
126
+
127
+ Calm down and think this through! This is a classic lateral thinking puzzle. The key to escaping is not to open either door. Instead, you need to use what you have in the room with you.
128
+
129
+ Look up and examine the ceiling. Is it made of wood? If so, good. If not, this plan won't work.
130
+
131
+ Assuming it's made of wood, find a weak spot in the ceiling and start scratching at it with your fingernails. It'll take a while, but eventually, you'll create a small hole.
132
+
133
+ Once you have your hole, start screaming for help as loudly as you can. Someone will hear you eventually. When they do, they'll come to the room, open the door, and...
134
+
135
+ ...either the focused light or the dragon's fire will get them, not you!
136
+ ```
137
+
138
+ ```text
139
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
140
+
141
+ <|eot_id|><|start_header_id|>user<|end_header_id|>
142
+ I have a room with 3 doors and 4 windows. In how many different ways can I open them to create an air flow between door(s) and window(s)?
143
+
144
+ <|eot_id|><|start_header_id|>assistant<|end_header_id|>
145
+
146
+ Let's break this problem down step by step:
147
+
148
+ **Doors:**
149
+
150
+ You have 3 doors, and for each door, you have 2 options:
151
+ 1. Open it
152
+ 2. Close it
153
+
154
+ So, for all 3 doors, you have 2 × 2 × 2 = 2³ = 8 possible combinations of open and closed doors.
155
+
156
+ **Windows:**
157
+
158
+ You have 4 windows, and for each window, you have 2 options:
159
+ 1. Open it
160
+ 2. Close it
161
+
162
+ So, for all 4 windows, you have 2 × 2 × 2 × 2 = 2⁴ = 16 possible combinations of open and closed windows.
163
+
164
+ **Air flow condition:**
165
+
166
+ For there to be an air flow between door(s) and window(s), at least one door and one window must be open. Let's count the number of ways this condition is NOT met:
167
+
168
+ * Case 1: All doors are closed (1 way, since there's only 1 way to close all 3 doors) and any combination of windows are open or closed (2⁴ = 16 ways). This gives us 1 × 16 = 16 ways.
169
+ * Case 2: All windows are closed (1 way, since there's only 1 way to close all 4 windows) and any combination of doors are open or closed (2³ = 8 ways). This gives us 1 × 8 = 8 ways.
170
+
171
+ Notice that there's an overlap between these two cases, where all doors and all windows are closed (1 way for doors and 1way for windows), which has been counted twice. So, we subtract this overlap: 16 + 8 - 1 = 23.
172
+
173
+ Now, let's find the total number of ways to open doors and windows to create an air flow:
174
+
175
+ Total Ways = Total Combinations of Doors and Windows - Combinations without Air Flow
176
+ = (2³ × 2⁴) - 23
177
+ = (8 × 16) - 23
178
+ = 128 - 23
179
+ = 105
180
+
181
+ Therefore, there are 105 different ways to open the doors and windows to create an air flow between door(s) and window(s).
182
+ ```
183
+
184
+
185
+ ---
186
+ license: llama3
187
+ ---
188
+