Distillation Scaling Laws
Paper
•
2502.08606
•
Published
•
48
Nandan Kumar Jha
nandan523
·
AI & ML interests
Privacy and security of LLMs, and Cryptographically-secure machine learning
Recent Activity
authored
a paper
about 2 months ago
A Random Matrix Theory Perspective on the Learning Dynamics of
Multi-head Latent Attention
authored
a paper
about 2 months ago
Spectral Scaling Laws in Language Models: How Effectively Do
Feed-Forward Networks Use Their Latent Space?
commented on
a paper
about 2 months ago
Spectral Scaling Laws in Language Models: How Effectively Do
Feed-Forward Networks Use Their Latent Space?
Organizations
