alea-institute
/

kl3m-multi-word-002-32k

byte-pair-encoding

Model card Files Files and versions

kl3m-multi-word-002-32k / tokenizer.json

alea-institute's picture

Upload KL3M multi-word tokenizer v2 (32K)

be327e3 verified 18 days ago

history contribute delete

2.24 MB

File too large to display, you can check the raw version instead.