Inference Providers
Active filters: 70b
mradermacher/Llama3.1-70B-PlumChat-GGUF
71B • Updated • 126
mradermacher/Llama3.1-70B-PlumChat-i1-GGUF
71B • Updated • 301
mradermacher/CodeLlama-70B-Esper-GGUF
69B • Updated • 184
mradermacher/CodeLlama-70B-Esper-i1-GGUF
69B • Updated • 463
• 1
tensorblock/Llama3-70B-ShiningValiant2-GGUF
Text Generation
• 71B • Updated • 13
tensorblock/Llama3-70B-Fireplace-GGUF
Text Generation
• 71B • Updated • 37
hierholzer/Llama-3.3-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 194
• 1
mradermacher/Llama2-70B-StellarBright-GGUF
69B • Updated • 32
mradermacher/Llama2-70B-StellarBright-i1-GGUF
69B • Updated • 127
roleplaiapp/Llama-3.3-70B-Instruct-Q5_0-GGUF
Text Generation
• 71B • Updated • 4
roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_S-GGUF
Text Generation
• 71B • Updated • 9
roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_M-GGUF
Text Generation
• 71B • Updated • 68
roleplaiapp/Llama-3.3-70B-Instruct-Q6_K-GGUF
Text Generation
• 71B • Updated • 29
roleplaiapp/Llama-3.3-70B-Instruct-Q8_0-GGUF
Text Generation
• 71B • Updated • 17
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF
Text Generation
• 71B • Updated • 17
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF
Text Generation
• 71B • Updated • 15
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF
Text Generation
• 71B • Updated • 23
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF
Text Generation
• 71B • Updated • 17
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF
Text Generation
• 71B • Updated • 6
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF
Text Generation
• 71B • Updated • 9
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF
Text Generation
• 71B • Updated • 102
• 2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF
Text Generation
• 71B • Updated • 9
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF
Text Generation
• 71B • Updated • 18
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF
Text Generation
• 71B • Updated • 68
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF
Text Generation
• 71B • Updated • 23
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF
Text Generation
• 71B • Updated • 35
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF
Text Generation
• 71B • Updated • 26
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF
Text Generation
• 71B • Updated • 25
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF
Text Generation
• 71B • Updated • 22
• 1
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF
Text Generation
• 71B • Updated • 14