Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,702

Base only

Active filters: awq

shawnw3i/Qwen3.6-27B-AWQ-MTP

Image-Text-to-Text • 6B • Updated 4 days ago • 1.8k • 3

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 757k • 135

cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit

Image-Text-to-Text • 36B • Updated 3 days ago • 1.29M • 71

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q2_K_XL-mlx

Text Generation • 4B • Updated 18 days ago • 1.13k • 6

TheBloke/dolphin-2.1-mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 67 • 22

TheBloke/SauerkrautLM-7B-v1-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 25 • 2

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • 73B • Updated Oct 9, 2024 • 1.82M • 78

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ-BF16Mix

Text Generation • 31B • Updated Sep 5, 2025 • 1.17k • 5

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 49.7k • 26

KRAFTON/Raon-Speech-9B-AWQ-INT4

Any-to-Any • 9B • Updated Apr 7 • 43 • 9

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated 1 day ago • 376 • 2

prism-ml/Bonsai-8B-AWQ-4-bit

Text Generation • 8B • Updated 29 days ago • 467 • 2

QuantTrio/GLM-5.1-AWQ

Text Generation • 754B • Updated Apr 21 • 1.55k • 8

selode-ai/Qwen-3.6-35B-A3B-VRAP-4-bit-AWQ-21.2GB

Image-Text-to-Text • 29B • Updated Apr 21 • 12.9k • 15

shawnw3i/Huihui-Qwen3.6-27B-abliterated-AWQ-MTP

Image-Text-to-Text • 6B • Updated 11 days ago • 20k • 6

cyankiwi/Laguna-XS.2-AWQ-INT4

Text Generation • 33B • Updated 20 days ago • 5.16k • 2

drawais/Qwen3-Embedding-0.6B-AWQ-INT4

Text Generation • 0.6B • Updated about 1 month ago • 4.37k • 3

louismuk/gemma-4-26B-A4B-heretic-AWQ

Text Generation • 27B • Updated 26 days ago • 2.6k • 2

mconcat/Qwopus3.6-27B-v2-AWQ-4bit

Text Generation • 11B • Updated 8 days ago • 9.96k • 2

philbert440/Qwen3.6-40B-DeckardUncensored-OpusDistilled-HermesCalibrated-W4A16-AWQ

Image-Text-to-Text • 40B • Updated 6 days ago • 541 • 3

aldi2512/Qwen3.6-35B-A3B-Indonesia-Uncensored-AWQ-4bit

Image-Text-to-Text • 35B • Updated 7 days ago • 184 • 1

Reza2kn/Cosmos3-Nano-INT4-AWQ

Text-to-Image • Updated about 8 hours ago • 9 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 19 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 490 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 7 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 7 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 5

casperhansen/opt-125m-awq

Text Generation • 0.2B • Updated Oct 31, 2023 • 925 • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 29 • 1

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023