Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

25,699

Full-text search

Active filters: 8-bit

FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-SFT-8.0bpw-h8-exl2

Text Generation • Updated Jul 16, 2024

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • 7B • Updated Jul 16, 2024 • 72.8k • 7

bullerwins/mathstral-7B-v0.1-exl2_8.0bpw

Text Generation • Updated Jul 16, 2024 • 1

iaincambeul/mistral-7b-instruct-v0.2-imp-fm-exp

Updated Jul 16, 2024 • 1

Toby0830/internlm2_5-7b-chat-1m-gptq-8bits

Feature Extraction • 3B • Updated Jul 16, 2024 • 1

amgadhasan/NeuralDaredevil-7B-exl2-8bpw

Text Generation • Updated Jul 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

userdata/whisper-largeV2-03-ms-v11-LORA-Merged

Automatic Speech Recognition • 2B • Updated Jul 17, 2024

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 190 • 6

abhinayadutta/deepseek-coder-1.3b-base-int8-Scala-codegen

Text Generation • 1B • Updated Jul 17, 2024

Shaleen123/yi-1.5-9b-maths

Text Generation • 9B • Updated Jul 17, 2024

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • 71B • Updated Jul 17, 2024 • 89 • 4

aryamannningombam/llama-3-GPTQ_g64-8bits

Text Generation • 3B • Updated Jul 17, 2024

AminBH/Llama-3-8B-GPTQ-wiki-8bit

Text Generation • 3B • Updated Jul 17, 2024

Xu-Ouyang/pythia-14m-int8-step36000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024

Xu-Ouyang/pythia-14m-int8-step71000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024

Xu-Ouyang/pythia-14m-int8-step107000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024 • 3

Xu-Ouyang/pythia-14m-int8-step110000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024

Xu-Ouyang/pythia-14m-int8-step143000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024

bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 2

bigstorm/firefunction-v2-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 1

bigstorm/gemma-2-27b-it-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 4

LeroyDyer/_Spydaz_Web_AI_MistralStar_4BIT

Text Generation • 4B • Updated Jul 25, 2024 • 2

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • 12B • Updated Jul 22, 2024 • 88.9k • 48

DrNicefellow/Mistral-Nemo-Instruct-2407-exl2-8bpw-h8

Text Generation • Updated Jul 18, 2024 • 4 • 7

infly/INF-34B-Chat-GPTQ-8bit

Text Generation • 10B • Updated Jul 25, 2024 • 60