Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,576

Base only

Active filters: gptq

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1

Text Generation • 27B • Updated 29 minutes ago • 853 • 5

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated 22 days ago • 2.38k • 9

onnx-community/PaddleOCR-VL-1.5-ONNX

Updated 26 days ago • 356 • 4

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 70 • 319

TheBloke/dolphin-2.1-mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 11, 2023 • 51 • 36

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Oct 9, 2024 • 74.5k • 14

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Nov 18, 2024 • 876 • 22

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated Apr 24 • 37.7k • 29

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated Apr 24 • 425k • 55

dataslab/DLM-2.0-14B-GPTQ

Text Generation • 3B • Updated Apr 30 • 13 • 2

dataslab/DLM-2.1-14B-GPTQ

Text Generation • 3B • Updated Apr 30 • 10 • 2

groxaxo/lukey03-Qwen3.5-9B-abliterated-gptq-pro-w4g128

Text Generation • 9B • Updated Mar 23 • 129 • 2

caiovicentino1/Qwopus3.5-27B-v3-HLWQ-v7-GPTQ

Text Generation • 27B • Updated Apr 13 • 15 • 6

Vishva007/gemma-4-E4B-it-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 4B • Updated 23 days ago • 55.4k • 4

0xSero/GLM-5.1-555B-W4A16

Text Generation • 78B • Updated 2 days ago • 918 • 8

shieldstar/Qwen3.6-35B-A3B-int4-AutoRound-EC

Image-Text-to-Text • 6B • Updated Apr 23 • 12.2k • 7

groxaxo/Qwen3.6-27B-GPTQ-Pro-4bit

Image-Text-to-Text • 27B • Updated Apr 23 • 126k • 37

llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 25 days ago • 26.4k • 3

AxisQuant/Qwen3.6-27b-gptq-int4

Text Generation • 27B • Updated 4 days ago • 13.2k • 3

Reza2kn/mega-asr-onnx

Automatic Speech Recognition • Updated 11 days ago • 217 • 3

llmfan46/Qwen3.5-27B-uncensored-heretic-v2-Native-MTP-Preserved-GPTQ-Int4

Image-Text-to-Text • 27B • Updated 7 days ago • 150 • 1

shinigamiRaj/Llama-3.2-1B-Instruct-gptqmodel-4bit

1B • Updated 1 day ago • 34 • 1

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 15 • 40

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 22 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 16 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 20 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 8 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 9 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 17 • 45

TheBloke/koala-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 49 • 31