Vaibhav (VB) Srivastav @reach_vb

LOVE ITT! You can run Kimi K2 (1T token MoE) on a single M4 Max 128GB VRAM (w/ offloading) or a single M3 Ultra (512GB) 🔥

The model was released less than 72 hours ago - love how fast the community optimises open weights - kudos to @UnslothAI 🤗

https://t.co/DWLiauvINX

huggingface.co

unsloth/Kimi-K2-Instruct-GGUF · Hugging Face