https://github.com/jzhang38/LongMamba
Zhang Peiyuan
PY007
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
5 days ago
Efficient Long-context Language Model Training by Core Attention
Disaggregation
upvoted
a
paper
about 2 months ago
K2-Think: A Parameter-Efficient Reasoning System
upvoted
a
paper
2 months ago
Deep Think with Confidence
Organizations
https://github.com/jzhang38/EasyContext
-
PY007/slimpajama_llama_tokenized_upsample_4096_chunk_1M
Viewer • Updated • 5.04k • 244 • 2 -
PY007/slimpajama_llama_tokenized_upsample_4096_chunk_256K
Viewer • Updated • 3.94k • 16 • 1 -
PY007/EasyContext-1M-Llama-2-7B
Text Generation • 7B • Updated • 1 • 4 -
PY007/slimpajama_mistral_tokenized_upsample_4096_chunk_128K
Viewer • Updated • 37.9k • 52
https://github.com/jzhang38/LongMamba
https://github.com/jzhang38/EasyContext
-
PY007/slimpajama_llama_tokenized_upsample_4096_chunk_1M
Viewer • Updated • 5.04k • 244 • 2 -
PY007/slimpajama_llama_tokenized_upsample_4096_chunk_256K
Viewer • Updated • 3.94k • 16 • 1 -
PY007/EasyContext-1M-Llama-2-7B
Text Generation • 7B • Updated • 1 • 4 -
PY007/slimpajama_mistral_tokenized_upsample_4096_chunk_128K
Viewer • Updated • 37.9k • 52
models
5
PY007/slimpajama_LLAMA3_tokenized_chunk_512K_debug
Updated
PY007/vicuna-7b-v1.5
Text Generation
•
7B
•
Updated
•
1
PY007/EasyContext-256K-danube2-1.8b
Text Generation
•
2B
•
Updated
•
5
PY007/EasyContext-1M-Llama-2-7B
Text Generation
•
7B
•
Updated
•
1
•
4
PY007/LongMamba_16384_bs128_step400
Updated
•
1
•
5
datasets
23
PY007/crush-smol
Viewer
•
Updated
•
4
•
6
PY007/slimpajama_Qwen2_tokenized_upsample_4096_chunk_256K
Viewer
•
Updated
•
6.79k
•
164
PY007/slimpajama_Yi1.5_tokenized_upsample_4096_chunk_256K
Viewer
•
Updated
•
7.48k
•
16
PY007/slimpajama_llama2_tokenized_upsample_4096_chunk_256K
Viewer
•
Updated
•
7.79k
•
83
PY007/slimpajama_LLAMA3_tokenized_upsample_4096_chunk_256K
Viewer
•
Updated
•
6.64k
•
12
PY007/wild_chat_llama3_template_tokenized_merged_1M
Viewer
•
Updated
•
1.27k
•
47
PY007/wildchat_llama3_template
Updated
•
5
PY007/slimpajama_llama_tokenized_chunk_upsample_100K_books_1M
Viewer
•
Updated
•
2.74k
•
584
PY007/slimpajama_mistral_tokenized_chunk_upsample_4096_512K
Viewer
•
Updated
•
947
•
105
PY007/slimpajama_LLAMA3_tokenized_chunk_512K
Viewer
•
Updated
•
11.3k
•
296