instruction-pretrain's picture

instruction-pretrain

instruction-pretrain

·

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Recent Activity

upvoted a paper about 1 month ago

FlowRL: Matching Reward Distributions for LLM Reasoning

upvoted a paper 4 months ago

Reasoning with Exploration: An Entropy Perspective

new activity 5 months ago

instruction-pretrain/finance-Llama3-8B:How large is the corpus size used for pretraining the finance LLaMA?

View all activity

Organizations

None yet

instruction-pretrain 's models 5

instruction-pretrain/InstructLM-500M

Text Generation • 0.6B • Updated Mar 4 • 25 • 34

instruction-pretrain/InstructLM-1.3B

Text Generation • 1B • Updated Mar 4 • 8 • 43

instruction-pretrain/finance-Llama3-8B

Text Generation • 8B • Updated Mar 1 • 36 • • 71

instruction-pretrain/medicine-Llama3-8B

Text Generation • 8B • Updated Mar 1 • 3 • 38

instruction-pretrain/instruction-synthesizer

Text Generation • 7B • Updated Mar 1 • 46 • 79