Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

120

Base only

Active filters: ik_llama.cpp

sokann/GLM-5.2-GGUF-2.244bpw

753B • Updated 2 days ago • 527 • 4

ubergarm/Qwen3.5-397B-A17B-GGUF

Text Generation • 396B • Updated Apr 3 • 410 • 37

ubergarm/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated 17 days ago • 8.7k • 33

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated about 1 month ago • 8.3k • 20

ubergarm/Step-3.5-Flash-GGUF

Text Generation • 197B • Updated Feb 16 • 210 • 42

ubergarm/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 26 • 300 • 21

ubergarm/Qwen3.5-122B-A10B-GGUF

Text Generation • 122B • Updated Mar 20 • 2.75k • 20

ubergarm/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated Mar 16 • 342 • 10

ubergarm/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated Apr 24 • 168 • 18

ubergarm/GLM-5.1-GGUF

Text Generation • 754B • Updated Apr 9 • 1.14k • 25

sokann/GLM-5.1-GGUF-1.673bpw

754B • Updated Apr 12 • 310 • 4

ubergarm/MiniMax-M2.7-GGUF

Text Generation • 229B • Updated Apr 15 • 391 • 21

ubergarm/Kimi-K2.6-GGUF

Text Generation • 1T • Updated Apr 27 • 629 • 37

Radamanthys11/Qwen3.5-122B-A10B-DFlash-GGUF

Text Generation • 0.5B • Updated 7 days ago • 222 • 1

sokann/DeepSeek-V4-Flash-GGUF

284B • Updated 5 days ago • 388 • 1

NexesQuants/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF

71B • Updated Jul 17, 2025 • 112

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 103 • 36

ubergarm/gemma-3-27b-it-qat-GGUF

Text Generation • Updated Jul 10, 2025 • 56 • 12

tdh111/bitnet-b1.58-2B-4T-GGUF

Text Generation • 3B • Updated May 16, 2025 • 356 • 10

ubergarm/Qwen3-235B-A22B-GGUF

Text Generation • Updated Jul 22, 2025 • 52 • 28

ArtusDev/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated May 2, 2025 • 7 • 2

ubergarm/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 10, 2025 • 48 • 20

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • Updated Jul 10, 2025 • 4 • 1

ubergarm/Qwen3-14B-GGUF

Text Generation • Updated Jul 19, 2025 • 26 • 4

NexesQuants/mistral-small-3.1-24b-instruct-2503-iMat-IKLQ-GGUF

24B • Updated Jul 5, 2025 • 16

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • Updated Jul 19, 2025 • 259 • 50

NexesQuants/SicariusSicarii_Nano_Imp_1B-iMat-IKL-NXS-CQ-GGUF

1B • Updated Jul 5, 2025 • 11 • 1

NexesQuants/Gemma-3-4b_X-Ray-Abli_Linear_v1.01-iMat-IKL-NXS-CQ-GGUF

4B • Updated Jul 5, 2025 • 3

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Nov 27, 2025 • 16 • 9

NexesQuants/Fallen-Gemma3-27B-v1-Q8_0-iMat-IKL-NXS-GGUF

27B • Updated Jul 5, 2025 • 1