bigscience-catalogue-data-dev
/

byte-level-bpe-tokenizer-no-norm-250k

Model card Files Files and versions

byte-level-bpe-tokenizer-no-norm-250k / tokenizer.json

TimeRobber

Add tokenizer

5add963 about 4 years ago

history blame contribute delete

12.6 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 4e363038fd75db1a32f53d844c91fe9429d097800da4ab0c95811167c31db022
Size of remote file:: 12.6 MB
SHA256:: 9e29a75ff046c56189a2535880d95bc6e31ed9f82e83561553ba910ff0482161

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.