Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
nursimakgul
/
turkish-tokenizer
like
0
Turkish
turkish
tokenizer
bpe
nlp
License:
mit
Model card
Files
Files and versions
xet
Community
main
turkish-tokenizer
4.67 MB
1 contributor
History:
5 commits
nursimakgul
Upload README.md with huggingface_hub
4f31224
verified
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
README.md
1.03 kB
Upload README.md with huggingface_hub
3 months ago
tokenizer_config.json
433 Bytes
Upload tokenizer_config.json with huggingface_hub
3 months ago
turkish_tokenizer.json
3.84 MB
Upload turkish_tokenizer.json with huggingface_hub
3 months ago
vocabulary.txt
826 kB
Upload vocabulary.txt with huggingface_hub
3 months ago