hunyuan-moe / special_tokens_map.json
yujiepan's picture
Upload folder using huggingface_hub
aab67e0 verified
raw
history blame contribute delete
187 Bytes
{
"additional_special_tokens": [
"<|startoftext|>",
"<|extra_0|>",
"<|extra_4|>",
"<|extra_5|>",
"<|eos|>"
],
"eos_token": "<|eos|>",
"pad_token": "<|pad|>"
}