instruction-pretrain
/

instruction-synthesizer

Text Generation

text-generation-inference

Model card Files Files and versions

instruction-pretrain commited on Jun 21, 2024

Commit

5e932be

·

verified ·

1 Parent(s): 85c4729

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ We explore supervised multitask pre-training by proposing ***Instruction Pre-Tra
 - Fine-Tuning Data for the Synthesizer: [ft-instruction-synthesizer-collection](https://huggingface.co/datasets/instruction-pretrain/ft-instruction-synthesizer-collection)
 - General Models Pre-Trained from Scratch:
   - [InstructLM-500M](https://huggingface.co/instruction-pretrain/InstructLM-500M)
-  - [InstructLLM-1.3B](https://huggingface.co/instruction-pretrain/InstructLLM-1.3B)
 - Domain-Specific Models Pre-Trained from Llama3-8B:
   - [Finance-Llama3-8B](https://huggingface.co/instruction-pretrain/finance-Llama3-8B)
   - [Biomedicine-Llama3-8B](https://huggingface.co/instruction-pretrain/medicine-Llama3-8B)

 - Fine-Tuning Data for the Synthesizer: [ft-instruction-synthesizer-collection](https://huggingface.co/datasets/instruction-pretrain/ft-instruction-synthesizer-collection)
 - General Models Pre-Trained from Scratch:
   - [InstructLM-500M](https://huggingface.co/instruction-pretrain/InstructLM-500M)
+  - [InstructLM-1.3B](https://huggingface.co/instruction-pretrain/InstructLM-1.3B)
 - Domain-Specific Models Pre-Trained from Llama3-8B:
   - [Finance-Llama3-8B](https://huggingface.co/instruction-pretrain/finance-Llama3-8B)
   - [Biomedicine-Llama3-8B](https://huggingface.co/instruction-pretrain/medicine-Llama3-8B)