webbigdata
/

nanochat-jp_base

Model card Files Files and versions

nanochat-jp_base / tokenizer

1.32 MB

1 contributor

History: 1 commit

dahara1's picture

Upload 4 files

d2c95c3 verified about 2 months ago

token_bytes.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.IntStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
264 kB
xet

Upload 4 files about 2 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
1.05 MB
xet

Upload 4 files about 2 months ago