Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

39

Full-text search

Active filters: open4bits

Open4bits/LFM2.5-1.2B-Base-Quantized

Text Generation • Updated 27 days ago

Open4bits/granite-4.0-h-micro-quantized

Text Generation • Updated 27 days ago

Open4bits/gemma-3-270m-it-gguf

Text Generation • 0.3B • Updated 10 days ago • 1.19k

Open4bits/Qwen3-0.6b-gguf

Text Generation • 0.8B • Updated 29 days ago • 548

Open4bits/whisper-tiny-f16

Automatic Speech Recognition • 37.8M • Updated 29 days ago • 33

Open4bits/whisper-base-f16

Automatic Speech Recognition • 72.6M • Updated 29 days ago • 31

Open4bits/llama-3.2-1b-onnx

Text Generation • Updated 27 days ago • 26

Open4bits/Qwen3-0.6B-onnx

Text Generation • Updated 27 days ago • 12

Open4bits/llama3.2-1b-gguf

Text Generation • 1B • Updated 25 days ago • 643

Open4bits/EXAONE-4.0-1.2B-gguf

Text Generation • 1B • Updated 24 days ago • 637

Open4bits/Ministral-3-3B-Base-2512-gguf

Image-Text-to-Text • 3B • Updated 23 days ago • 452

Open4bits/Schematron-3B-gguf

Text Generation • 3B • Updated 23 days ago • 304

Open4bits/granite-4.0-micro-mlx-3Bit

Text Generation • 0.4B • Updated 18 days ago • 136

Open4bits/gpt-oss-120b-mlx-2Bit

Text Generation • 117B • Updated 20 days ago • 384 • 1

Open4bits/gpt-oss-20b-mlx-2Bit

Text Generation • 21B • Updated 20 days ago • 283

Open4bits/EXAONE-4.0-1.2B-mlx-fp16

Text Generation • 1B • Updated 19 days ago • 70

Open4bits/Qwen3-Coder-Next-mlx-2Bit

Text Generation • 80B • Updated 19 days ago • 441

Open4bits/Soprano-1.1-80M-mlx-fp16

Text-to-Speech • 79.7M • Updated 19 days ago • 19

Open4bits/granite-4.0-micro-mlx-fp16

Text Generation • 3B • Updated 19 days ago • 34

Open4bits/gpt-oss-20b-mlx-fp16

Text Generation • 21B • Updated 19 days ago • 347

Open4bits/sarvam-1-GGUF

Text Generation • 3B • Updated about 20 hours ago • 176

Open4bits/granite-4.0-h-tiny-mlx-fp16

Text Generation • 7B • Updated 18 days ago • 74

Open4bits/Llama-3.2-3B-GGUF

Text Generation • 3B • Updated 17 days ago • 468

Open4bits/Ministral-3-3B-Base-2512-mlx-mxfp4

3B • Updated 18 days ago • 76

Open4bits/DeepSeek-R1-mlx-2Bit

Text Generation • 671B • Updated 18 days ago • 657

Open4bits/Ministral-3-3B-Base-2512-mlx-fp16

3B • Updated 18 days ago • 98

Open4bits/Olmo-3.1-32B-Think-mlx-2Bit

Text Generation • 32B • Updated 18 days ago • 71

Open4bits/Qwen2.5-Omni-7B-GGUF

Any-to-Any • 8B • Updated 17 days ago • 42

Open4bits/MiniMax-M2-GGUF

Text Generation • 229B • Updated 16 days ago • 58

Open4bits/Qwen3-14B-Base-mlx-fp16

Text Generation • 15B • Updated 15 days ago • 42