IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

soroushtabesh authored a paper about 15 hours ago

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

SpiridonSunRotator updated a model 3 days ago

ISTA-DASLab/Kimi-K2-Thinking-GPTQ-2b-32g-experts

SpiridonSunRotator published a model 3 days ago

ISTA-DASLab/Kimi-K2-Thinking-GPTQ-2b-32g-experts

View all activity

Papers

Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

View all Papers

ISTA-DASLab 's models 145

ISTA-DASLab/Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • 8B • Updated May 16, 2024 • 4 • 1

ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 13, 2024 • 7 • 20

ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024

ISTA-DASLab/Phi-3-mini-128k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 1

ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 4, 2024 • 2 • 14

ISTA-DASLab/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Apr 23, 2024

ISTA-DASLab/c4ai-command-r-plus-AQLM-2Bit-1x16

Text Generation • 16B • Updated Apr 21, 2024 • 10

ISTA-DASLab/Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8

Text Generation • 2B • Updated Apr 13, 2024 • 2 • 3

ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16

Text Generation • 6B • Updated Apr 13, 2024 • 10

ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 3 • 2

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf

Text Generation • 18B • Updated Mar 11, 2024 • 5 • 1

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf

Text Generation • 9B • Updated Mar 11, 2024 • 6

ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf

Text Generation • 2B • Updated Mar 11, 2024

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf

Text Generation • 2B • Updated Mar 11, 2024

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 120 • 2

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 83 • 5

ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Mar 11, 2024 • 24 • 23

ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf

Text Generation • 1B • Updated Mar 10, 2024 • 1 • 4

ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

Text Generation • 0.8B • Updated Mar 10, 2024 • 8 • 6

ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Feb 27, 2024 • 6 • 18

ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf

Text Generation • Updated Feb 10, 2024 • 5

ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation • 18B • Updated Feb 10, 2024 • 1

ISTA-DASLab/switch-c-2048_qmoe

Updated Oct 25, 2023 • 2 • 4

ISTA-DASLab/switch-large-128_qmoe

Updated Oct 25, 2023 • 1

ISTA-DASLab/switch-base-128_qmoe

Updated Oct 25, 2023 • 1