Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

model-compression

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

248

Base only

Active filters: model-compression

rtj1/Qwen2.5-0.5B-AWQ-FP8-Block

Text Generation • 0.6B • Updated Feb 10 • 16

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-c4-1000

Text Generation • 12B • Updated Feb 28 • 27

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-1000

Text Generation • 12B • Updated Feb 28 • 23

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-100

Text Generation • 12B • Updated Feb 28 • 25

MoNE-Pruning/Qwen2-57B-A14B-MoNE-48-zyda2-100

Text Generation • 45B • Updated Feb 28 • 16

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-math-100

Text Generation • 45B • Updated Mar 2 • 39

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-gsm8k-100

Text Generation • 45B • Updated Mar 2 • 25

animeshakr/oct-retinal-weights

Image Classification • Updated Jul 14 • 21 • 2

robotflowlabs/FORGE-Nano-Benchmark

Robotics • Updated Mar 19

alonsopg/qwen2audio-selected-layer-codec-q2

alonsopg/qwen2audio-selected-layer-codec-q3

gomyk/qwen3-student-qwen3_compressed

Sentence Similarity • 12.4M • Updated Mar 26 • 17

gomyk/qwen3-student-qwen3_compressed_distilled

Sentence Similarity • 12.4M • Updated Mar 26 • 17

gomyk/me5s-student-me5s_compressed

Sentence Similarity • 13.3M • Updated Mar 27 • 17

gomyk/me5s-student-me5s_compressed_distilled

Sentence Similarity • 13.3M • Updated Mar 27 • 74

gomyk/gte-student-gte_compressed

Sentence Similarity • 12.8M • Updated Mar 27 • 21

gomyk/gte-student-gte_compressed_distilled

Sentence Similarity • 12.8M • Updated Mar 27 • 15

gomyk/gemma-student-gemma_emb_compressed

Sentence Similarity • 12.5M • Updated Mar 27 • 19

gomyk/gemma-student-gemma_emb_compressed_distilled

Sentence Similarity • 12.5M • Updated Mar 27 • 22

gomyk/gemma-student-gemma_emb_mrl_distilled_128d

Sentence Similarity • 11.2M • Updated Mar 30 • 16

gomyk/jina-v5-student-jina_v5_compressed_distilled_v2

Sentence Similarity • 19.3M • Updated Mar 31 • 16

gomyk/jina-v5-student-jina_v5_compressed_distilled_10ep

Sentence Similarity • 19.3M • Updated Mar 31 • 18

gomyk/jina-v5-student-jina_v5_compressed_distilled_trainonly

Sentence Similarity • 19.3M • Updated Apr 1 • 21

gomyk/jina-v5-student-jina_v5_compressed

Sentence Similarity • 19.1M • Updated Apr 1 • 15

gomyk/jina-v5-student-jina_v5_compressed_distilled

Sentence Similarity • 19.1M • Updated Apr 1 • 19 • 1

gomyk/jina-v5-h256-distilled

Sentence Similarity • 17M • Updated Apr 2 • 25

gomyk/jina-v5-h256-lora-classification

Text Classification • Updated Apr 6

gomyk/jina-v5-h256-lora-classification-universal

Text Classification • Updated Apr 6

gomyk/jina-v5-h256-lora-clf-merged

Sentence Similarity • 17M • Updated Apr 6 • 33

iLearn-Lab/ICMR25-HMKD