File size: 877 Bytes
9ee47d7
c48cf60
 
9ee47d7
c48cf60
 
9ee47d7
 
c48cf60
9ee47d7
c48cf60
9ee47d7
c48cf60
9ee47d7
c48cf60
9ee47d7
c48cf60
9ee47d7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c48cf60
9ee47d7
c48cf60
9ee47d7
 
 
 
 
c48cf60
9ee47d7
c48cf60
9ee47d7
 
 
c48cf60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49

---
library_name: transformers
base_model: Qwen/Qwen1.5-4B-Chat
---

# Model card of JOSIExQwen1.5_4B_chat
## This is my Token customized Qwen/Qwen1.5-4B-Chat model

[Origional Model][https://huggingface.co/Qwen/Qwen1.5-4B-Chat]

This is based on Qwen/Qwen1.5-4B-Chat model with added custom special Tokens.

<br>

### New added Special Tokens

```text
'<|functions|>',
'<|gökdeniz|>',
'<|user|>',
'<|josie|>',
'<|assistant|>',
'<|function_call|>',
'<|function_response|>',
'<|image|>',
'<|long_term_memory|>',
'<|short_term_memory|>',
'<|home_state|>',
'<|current_states|>',
'<|context|>'
```
<br>

### New BOS and EOS Tokens

```text
BOS = '<|startoftext|>'
EOS = '<|endoftext|>'
```
<br>

### New added Normal Tokens

```text
['Gökdeniz Gülmez', 'Gökdeniz', 'Gülmez', 'JOSIE', 'J.O.S.I.E.', 'Josie', 'josie', 'Just an Outstandingly Smart and Intelligent Entity']
```