Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

6,732

Base only

Active filters: compressed-tensors

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-4bit-gsm8k

14B • Updated Nov 7, 2025 • 7

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-8bit-gsm8k

14B • Updated Nov 7, 2025 • 5

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-simple-8bit-gsm8k

14B • Updated Nov 7, 2025 • 1

mratsim/GLM-4.5-Iceblink-106B-A12B-AWQ

Text Generation • 23B • Updated Nov 8, 2025 • 5

mratsim/GLM-Steam-106B-A12B-v1-AWQ

Text Generation • 23B • Updated Nov 8, 2025 • 2

mratsim/GLM-4.5-Iceblink-v2-106B-A12B-AWQ

Text Generation • 23B • Updated Nov 8, 2025 • 3

ISTA-DASLab/Kimi-K2-Thinking-GPTQ-2b-32g-experts

1.1T • Updated Nov 20, 2025 • 2

mratsim/Behemoth-X-123B-v2-NVFP4

Text Generation • 69B • Updated Nov 9, 2025 • 79 • 4

mratsim/Monstral-123B-v2-NVFP4

Text Generation • 69B • Updated Nov 9, 2025 • 38 • 1

AxeCameron/RuadaptQwen3-32B-Instruct-NVFP4-University

19B • Updated Nov 9, 2025 • 1

AxeCameron/RuadaptQwen3-32B-Instruct-W4A16-G128-University

6B • Updated Nov 9, 2025 • 1

AxeCameron/RuadaptQwen3-32B-Instruct-NVFP4A16-University

19B • Updated Nov 9, 2025

AxeCameron/RuadaptQwen3-32B-Instruct-W8A8-float-University

33B • Updated Nov 9, 2025

AxeCameron/RuadaptQwen3-32B-Instruct-W8A8-int-University

33B • Updated Nov 9, 2025 • 1

mratsim/Dungeonmaster-V2.2-Expanded-LLaMa-70B-NVFP4

Text Generation • 41B • Updated Nov 9, 2025 • 3

mratsim/Dungeonmaster-V2.2-Expanded-LLaMa-70B-NVFP4A16

Text Generation • 41B • Updated Nov 9, 2025 • 2

mratsim/70B-L3.3-Cirrus-x1-NVFP4A16

Text Generation • 41B • Updated Nov 9, 2025 • 1 • 1

mratsim/70B-L3.3-Cirrus-x1-NVFP4

Text Generation • 41B • Updated Nov 9, 2025 • 16

Nulia/UnslopNemo-12B-v4-FP8-Dynamic

Text Generation • 12B • Updated Nov 9, 2025 • 1

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-8bit-ifeval

14B • Updated Nov 10, 2025 • 6

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-4bit-ifeval

14B • Updated Nov 10, 2025 • 6

BaoLocTown/quanti-network-gemma-awq

3B • Updated Nov 10, 2025 • 1

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-awq-4bit-ifeval

14B • Updated Nov 10, 2025 • 3

cyankiwi/MiniMax-M2-AWQ-4bit

Text Generation • 37B • Updated 26 days ago • 80 • 4

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-4bit-mmlu

14B • Updated Nov 10, 2025 • 5

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-8bit-mmlu

14B • Updated Nov 10, 2025 • 4

BaoLocTown/thanh-gemma-gptq

3B • Updated Nov 11, 2025 • 1

BaoLocTown/quanti-gemma-lora

3B • Updated Nov 11, 2025 • 1

thanhh12/Seed-X-PPO-7B-GPTQ-INT8

Translation • 8B • Updated Nov 11, 2025 • 1 • 1

Kark07/Qwen1.5-MoE-A2.7B-llmcomp-gptq-4bit-bbh

14B • Updated Nov 11, 2025 • 6