Pretrained Language Model Embryology: The Birth of ALBERT
Paper
•
2010.02480
•
Published
Sung-Feng Huang
sungfengh
AI & ML interests
None yet
Recent Activity
updated
a dataset
6 days ago
PeacefulData/SINE_v2
upvoted
a
paper
7 days ago
4D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillation
new activity
13 days ago
PeacefulData/SINE_v2:[bot] Conversion to Parquet
Organizations
authored
4
papers
3 months ago
Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization
Paper
•
2402.01692
•
Published
•
1
Generative Speech Foundation Model Pretraining for High-Quality Speech Extraction and Restoration
Paper
•
2409.16117
•
Published
DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignment
Paper
•
2507.02768
•
Published
•
18