Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
NovelAI
/
nerdstash-tokenizer-v2
like
8
Follow
NovelAI
135
English
Japanese
tokenizer
novelai
sentencepiece
License:
gpl-2.0
Model card
Files
Files and versions
xet
Community
main
nerdstash-tokenizer-v2
Commit History
Add sentencepiece tag
24ff1b6
finetune
commited on
Aug 2, 2023
Add meta data
e5beb19
finetune
commited on
Aug 2, 2023
Add tokenizer
75d4e5d
finetune
commited on
Aug 2, 2023
initial commit
98f17f2
finetune
commited on
Aug 2, 2023