Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

6,997

Full-text search

Active filters: GGUF

RuneXX/LTX-2-Workflows

Updated about 14 hours ago • 256

huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF

Image-Text-to-Text • 1T • Updated about 17 hours ago • 153 • 6

tensorblock/SakanaAI_Llama-3-8B-Instruct-Coding-Expert-GGUF

Text Generation • 8B • Updated 28 days ago • 460 • 2

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 198k • 10

huihui-ai/Huihui-GLM-4.5-Air-abliterated-GGUF

Text Generation • 110B • Updated Dec 6, 2025 • 292 • 46

huihui-ai/Huihui-GLM-4.7-abliterated-GGUF

Text Generation • 358B • Updated 27 days ago • 1.75k • 24

steampunque/JoyAI-LLM-Flash-MP-GGUF

49B • Updated 3 days ago • 328 • 2

exdysa/MiniMax-M2.5-REAP-172B-A10B-GGUF-Q4_K_M

Text Generation • 173B • Updated 4 days ago • 357 • 2

mozilla-ai/llava-v1.5-7b-llamafile

7B • Updated Apr 1, 2025 • 3.82k • 182

MaziyarPanahi/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Feb 4, 2024 • 252 • 2

MaziyarPanahi/Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation • 12B • Updated Jun 15, 2024 • 93 • 1

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • 16B • Updated Jun 17, 2024 • 677 • 9

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 118k • 16

tensorblock/gpt2-650k-stable-diffusion-prompt-generator-GGUF

Text Generation • 0.2B • Updated 28 days ago • 157 • 3

tensorblock/aya-expanse-32b-ungated-GGUF

32B • Updated 28 days ago • 52 • 1

tensorblock/Llama-3.2-8B-Instruct-GGUF

8B • Updated 28 days ago • 811 • 3

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 119k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 123k • 16

tensorblock/Trendyol_Trendyol-LLM-8B-T1-GGUF

Text Generation • 8B • Updated 28 days ago • 45 • 1

tensorblock/huihui-ai_Huihui-Qwen3-1.7B-abliterated-v2-GGUF

Text Generation • 2B • Updated 28 days ago • 110 • 2

MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF

Text Generation • 21B • Updated Nov 28, 2025 • 62.6k • 2

steampunque/Qwen2.5-Coder-32B-Instruct-MP-GGUF

33B • Updated 7 days ago • 48 • 1

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 63.8k • 3

huihui-ai/Huihui-GLM-4.6V-abliterated-GGUF

Image-Text-to-Text • 107B • Updated Dec 24, 2025 • 781 • 7

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated 21 days ago • 10.1k • 19

MaziyarPanahi/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated 14 days ago • 17.4k • 1

rob-x-ai/OpenOrca-Platypus2-13B-GGUF

13B • Updated Aug 30, 2023 • 9 • 2

Trelis/openchat_3.5-function-calling-v3

Text Generation • 7B • Updated Mar 6, 2024 • 21

cosimoiaia/Loquace-7B-Mistral-GGUF

7B • Updated Dec 16, 2023 • 20 • 3

tsunemoto/Magicoder-S-CL-7B-GGUF

7B • Updated Dec 13, 2023 • 61 • 4