japanese-novel-gpt-j-6b / added_tokens.json
AIBunCho's picture
Upload tokenizer
a0e17e3
raw
history blame
No virus
58 Bytes
{
"[CLS]": 32000,
"[MASK]": 32002,
"[SEP]": 32001
}