InstaDeepAI
/

nucleotide-transformer-v2-50m-3mer-multi-species

Model card Files Files and versions

nucleotide-transformer-v2-50m-3mer-multi-species / tokenizer_config.json

sboshar's picture

Upload tokenizer

864cc9f verified over 1 year ago

history blame contribute delete

129 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"eos_token": null,
	"model_max_length": 2048,
	"tokenizer_class": "EsmTokenizer"
	}