Rectified Sparse Attention
Paper
•
2506.04108
•
Published
•
10
•
2
Yutao Sun
sunyt32
AI & ML interests
Machine Learning and Natural Language Processing
Recent Activity
upvoted
a
paper
27 days ago
Black-Box On-Policy Distillation of Large Language Models
upvoted
a
paper
3 months ago
Fantastic Pretraining Optimizers and Where to Find Them
liked
a model
4 months ago
microsoft/VibeVoice-1.5B
Organizations
None yet
commented
a
paper
6 months ago
commented
5
papers
over 2 years ago
Retentive Network: A Successor to Transformer for Large Language Models
Paper
•
2307.08621
•
Published
•
172
•
34
Retentive Network: A Successor to Transformer for Large Language Models
Paper
•
2307.08621
•
Published
•
172
•
34
Retentive Network: A Successor to Transformer for Large Language Models
Paper
•
2307.08621
•
Published
•
172
•
34
Retentive Network: A Successor to Transformer for Large Language Models
Paper
•
2307.08621
•
Published
•
172
•
34
Retentive Network: A Successor to Transformer for Large Language Models
Paper
•
2307.08621
•
Published
•
172
•
34