eurovoc_eu / added_tokens.json
scampion's picture
Upload tokenizer
34a0f3e
raw
history blame
No virus
91 Bytes
{
"</s>": 65537,
"<mask>": 65540,
"<pad>": 65539,
"<s>": 65536,
"<unk>": 65538
}