Activator: GLU Activations as The Core Functions of a Vision Transformer
Paper
•
2405.15953
•
Published
•
1
Abdullah Nazhat Abdullah
Abdullah-Nazhat
AI & ML interests
Computer Vision, Natural Language Processing, Large Language Models, Foundational Vision Models, Vision Language Models, Large Multi-Modal Models
Recent Activity
updated
a model
about 7 hours ago
Abdullah-Nazhat/TTT_Activator
updated
a model
about 7 hours ago
Abdullah-Nazhat/TTT_Uniform_MLP
updated
a model
about 8 hours ago
Abdullah-Nazhat/Context_PReLU
Organizations
None yet
upvoted
2
papers
over 1 year ago