LFM2-2.6B-GGUF

LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-2.6B

🏃 How to run LFM2

Example usage with llama.cpp:

llama-cli -hf LiquidAI/LFM2-2.6B-GGUF

Downloads last month: 5,956

GGUF

Model size

3B params

Architecture

lfm2

Hardware compatibility

4-bit

5-bit

6-bit

8-bit

16-bit

Model tree for LiquidAI/LFM2-2.6B-GGUF

Base model

LiquidAI/LFM2-2.6B

Quantized

(15)

this model

Collection including LiquidAI/LFM2-2.6B-GGUF

💧 LFM2

Collection

LFM2 is a new generation of hybrid models, designed for on-device deployment. • 21 items • Updated 7 days ago • 114