gpt-oss-20b gpt-oss-20b lokinfey/gpt-oss-20b-onnx-cpu-int4-matmul Updated Oct 28, 2025 • 6 lokinfey/gpt-oss-20b-onnx-cuda-int4-matmul Updated Aug 22, 2025 lokinfey/gpt-oss-20B-mlx-metal-int4 Text Generation • 21B • Updated Aug 9, 2025 • 43 • 1
Phi-4-Family Quantifying and transforming models from the Phi-4 Family lokinfey/Phi-4-mini-onnx-qnn-npu Updated Aug 12, 2025 • 3 lokinfey/Phi-4-reasoning-plus-ONNX-INT4-CPU Updated May 2, 2025 • 4 lokinfey/Phi-4-reasoning-plus-gguf 15B • Updated May 1, 2025 lokinfey/Phi-4-reasoning-plus-mlx-int4 Text Generation • 2B • Updated May 1, 2025 • 8
DeepSeek-Family Quantifying and transforming models from DeepSeek Family lokinfey/DeepSeek-R1-Distill-Qwen-1.5B-ONNX-INT4-CPU Updated Feb 1, 2025 lokinfey/DeepSeek-R1-Distill-Qwen-7B-ONNX-INT4-CPU Updated Jan 29, 2025 • 6 lokinfey/DeepSeek-R1-Distill-Qwen-14B-ONNX-INT4-GPU Updated Feb 1, 2025 • 4 • 2 lokinfey/DeepSeek-R1-Distill-Qwen-14B-INT4-MLX 2B • Updated Feb 1, 2025 • 1
Qwen3-Family Quantifying and transforming models from the Qwen3-Family lokinfey/Qwen3-14B-ONNX-INT4-CPU Updated Jun 29, 2025 • 5 • 1 lokinfey/Qwen3-8B-ONNX-INT4-CPU Updated Jun 29, 2025 • 6 • 1 lokinfey/Qwen3-4B-ONNX-INT4-CPU Updated Jun 29, 2025 • 10 lokinfey/Qwen3-1.7B-ONNX-INT4-CPU Updated Jun 29, 2025 • 8 • 1
Phi-3.5-Family Quantifying and transforming models from Phi-3.5 Family lokinfey/Phi-3.5-mini-instruct-ov-int4 Updated Aug 29, 2024 • 6 • 1 lokinfey/Phi-3.5-vision-ov-int4 Updated Aug 29, 2024 • 2 lokinfey/Phi-3.5-mini-instruct-onnx-gpu Updated Aug 29, 2024 lokinfey/Phi-3.5-mini-instruct-onnx-cpu Updated Aug 29, 2024 • 5
ChatGLM-Family Quantifying and transforming models from ChatGLM Family lokinfey/glm-edge-1.5b-chat-onnx-cpu-int4 Updated Dec 16, 2024 • 3 • 1 lokinfey/ChatGLM-4-ONNX-INT4-CPU Updated Dec 16, 2024 • 4 • 2
gpt-oss-20b gpt-oss-20b lokinfey/gpt-oss-20b-onnx-cpu-int4-matmul Updated Oct 28, 2025 • 6 lokinfey/gpt-oss-20b-onnx-cuda-int4-matmul Updated Aug 22, 2025 lokinfey/gpt-oss-20B-mlx-metal-int4 Text Generation • 21B • Updated Aug 9, 2025 • 43 • 1
Qwen3-Family Quantifying and transforming models from the Qwen3-Family lokinfey/Qwen3-14B-ONNX-INT4-CPU Updated Jun 29, 2025 • 5 • 1 lokinfey/Qwen3-8B-ONNX-INT4-CPU Updated Jun 29, 2025 • 6 • 1 lokinfey/Qwen3-4B-ONNX-INT4-CPU Updated Jun 29, 2025 • 10 lokinfey/Qwen3-1.7B-ONNX-INT4-CPU Updated Jun 29, 2025 • 8 • 1
Phi-4-Family Quantifying and transforming models from the Phi-4 Family lokinfey/Phi-4-mini-onnx-qnn-npu Updated Aug 12, 2025 • 3 lokinfey/Phi-4-reasoning-plus-ONNX-INT4-CPU Updated May 2, 2025 • 4 lokinfey/Phi-4-reasoning-plus-gguf 15B • Updated May 1, 2025 lokinfey/Phi-4-reasoning-plus-mlx-int4 Text Generation • 2B • Updated May 1, 2025 • 8
Phi-3.5-Family Quantifying and transforming models from Phi-3.5 Family lokinfey/Phi-3.5-mini-instruct-ov-int4 Updated Aug 29, 2024 • 6 • 1 lokinfey/Phi-3.5-vision-ov-int4 Updated Aug 29, 2024 • 2 lokinfey/Phi-3.5-mini-instruct-onnx-gpu Updated Aug 29, 2024 lokinfey/Phi-3.5-mini-instruct-onnx-cpu Updated Aug 29, 2024 • 5
DeepSeek-Family Quantifying and transforming models from DeepSeek Family lokinfey/DeepSeek-R1-Distill-Qwen-1.5B-ONNX-INT4-CPU Updated Feb 1, 2025 lokinfey/DeepSeek-R1-Distill-Qwen-7B-ONNX-INT4-CPU Updated Jan 29, 2025 • 6 lokinfey/DeepSeek-R1-Distill-Qwen-14B-ONNX-INT4-GPU Updated Feb 1, 2025 • 4 • 2 lokinfey/DeepSeek-R1-Distill-Qwen-14B-INT4-MLX 2B • Updated Feb 1, 2025 • 1
ChatGLM-Family Quantifying and transforming models from ChatGLM Family lokinfey/glm-edge-1.5b-chat-onnx-cpu-int4 Updated Dec 16, 2024 • 3 • 1 lokinfey/ChatGLM-4-ONNX-INT4-CPU Updated Dec 16, 2024 • 4 • 2
