JetMoE: Reaching Llama2 Performance with 0.1M Dollars
Paper
•
2404.07413
•
Published
•
38
gunasekar
GunA-SD
AI & ML interests
None yet
Recent Activity
liked
a model
9 days ago
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
liked
a model
11 days ago
Qwen/Qwen3-0.6B
updated
a dataset
over 1 year ago
GunA-SD/bash_code
Organizations
None yet
upvoted
11
papers
over 1 year ago
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models
Paper
•
2404.07839
•
Published
•
47
Rho-1: Not All Tokens Are What You Need
Paper
•
2404.07965
•
Published
•
93
TransformerFAM: Feedback attention is working memory
Paper
•
2404.09173
•
Published
•
43
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper
•
2404.08801
•
Published
•
66
Jamba: A Hybrid Transformer-Mamba Language Model
Paper
•
2403.19887
•
Published
•
111
PERL: Parameter Efficient Reinforcement Learning from Human Feedback
Paper
•
2403.10704
•
Published
•
59
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
190
SaulLM-7B: A pioneering Large Language Model for Law
Paper
•
2403.03883
•
Published
•
88
Priority Sampling of Large Language Models for Compilers
Paper
•
2402.18734
•
Published
•
19
Beyond Language Models: Byte Models are Digital World Simulators
Paper
•
2402.19155
•
Published
•
53
upvoted
5
papers
almost 2 years ago
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
627
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Paper
•
2402.13753
•
Published
•
116
BiLLM: Pushing the Limit of Post-Training Quantization for LLMs
Paper
•
2402.04291
•
Published
•
50
Diffuse to Choose: Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-All
Paper
•
2401.13795
•
Published
•
68
StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
Paper
•
2402.01391
•
Published
•
43