See https://github.com/michahu/pre-pretraining for more information.
Usage:
model = AutoModel.from_pretrained('michahu8/pythia-160m-shuffle-dyck-500steps')
tokenizer = AutoTokenizer.from_pretrained('EleutherAI/pythia-160m')
- Downloads last month
- 160