Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

arxiv: 2309.00071

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

1,133

Full-text search

Active filters: 2309.00071

vsevolodl/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • 8B • Updated May 10, 2024 • 365 • 1

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-262k-4bits

Text Generation • 5B • Updated May 10, 2024

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-262k-gguf

8B • Updated May 11, 2024 • 214 • 1

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-1048k-gguf

8B • Updated May 11, 2024 • 311

starsy/Llama-3-70B-Instruct-Gradient-262k-AWQ

Text Generation • 11B • Updated May 17, 2024 • 1

starsy/Llama-3-70B-Instruct-Gradient-1048k-AWQ

Text Generation • 11B • Updated May 17, 2024 • 1

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-4bits

Text Generation • 5B • Updated May 15, 2024

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-8bits

Text Generation • 8B • Updated May 15, 2024

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-gguf

8B • Updated May 15, 2024 • 263

Qwen/Qwen2-72B-Instruct

Text Generation • 73B • Updated Oct 8, 2024 • 23.8k • • 718

RichardErkhov/gradientai_-_Llama-3-70B-Instruct-Gradient-1048k-gguf

71B • Updated May 29, 2024 • 302

RichardErkhov/yanismiraoui_-_Yarn-Mistral-7b-128k-sharded-gguf

Updated Jun 1, 2024 • 68

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • 12B • Updated Aug 21, 2024 • 2.74k • 33

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • 21B • Updated Aug 21, 2024 • 60 • 15

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • 12B • Updated Aug 21, 2024 • 425 • 41

Qwen/Qwen2-57B-A14B-Instruct

Text Generation • 57B • Updated Aug 21, 2024 • 9.96k • 81

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • 2B • Updated Aug 21, 2024 • 872 • 29

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • 3B • Updated Aug 21, 2024 • 164 • 17

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • 2B • Updated Aug 21, 2024 • 1.52k • 22

LoneStriker/Qwen2-7B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Jun 6, 2024 • 1

LoneStriker/Qwen2-7B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Jun 6, 2024 • 1 • 1

LoneStriker/Qwen2-7B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jun 6, 2024

LoneStriker/Qwen2-7B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Jun 6, 2024

LoneStriker/Qwen2-7B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Jun 6, 2024

Zoyd/Qwen_Qwen2-7B-Instruct-2_2bpw_exl2

Text Generation • Updated Jun 6, 2024

Zoyd/Qwen_Qwen2-7B-Instruct-3_0bpw_exl2

Text Generation • Updated Jun 6, 2024

Zoyd/Qwen_Qwen2-7B-Instruct-2_5bpw_exl2

Text Generation • Updated Jun 6, 2024

Zoyd/Qwen_Qwen2-7B-Instruct-4_0bpw_exl2

Text Generation • Updated Jun 6, 2024

Zoyd/Qwen_Qwen2-7B-Instruct-3_5bpw_exl2

Text Generation • Updated Jun 6, 2024

Zoyd/Qwen_Qwen2-7B-Instruct-3_75bpw_exl2

Text Generation • Updated Jun 6, 2024