Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: dynquant

VikramPal/LFM2.5-8B-A1B-text2sql-DynQuant-4bit

Text Generation • 1B • Updated 8 days ago • 856 • 2

VikramPal/LFM2.5-8B-A1B-text2sql-bf16

Text Generation • 8B • Updated 9 days ago • 675 • 1

VikramPal/mistral-7b-instruct-v0.3-text2sql-bf16

Text Generation • 7B • Updated 5 days ago • 340

VikramPal/mistral-7b-instruct-v0.3-text2sql-DynQuant-4bit

Text Generation • 1B • Updated 5 days ago • 28

VikramPal/mistral-7b-instruct-v0.3-text2sql-DynQuant-3bit

Text Generation • 0.8B • Updated 5 days ago • 722

VikramPal/mistral-7b-instruct-v0.3-text2sql-lora

Text Generation • Updated 7 days ago • 9

VikramPal/Qwen3-Omni-30B-A3B-Thinker-SLURP-DynQuant-4bit

Audio-Text-to-Text • 4B • Updated 4 days ago • 29

VikramPal/Qwen3-Omni-30B-A3B-Thinker-SLURP-DynQuant-3bit

Audio-Text-to-Text • 3B • Updated 4 days ago • 28

VikramPal/Qwen3-Omni-30B-A3B-S2S-QLoRA

Any-to-Any • Updated 4 days ago

VikramPal/Qwen3-Omni-30B-A3B-S2S-DynQuant-3bit

Any-to-Any • 7B • Updated 4 days ago • 16

VikramPal/Qwen3-Omni-30B-A3B-S2S-DynQuant-4bit

Any-to-Any • 8B • Updated 4 days ago • 17

VikramPal/Qwen3-Omni-30B-A3B-S2S-bf16

Any-to-Any • 35B • Updated 4 days ago • 15

VikramPal/Qwen3.8-27B-text2sql-DynQuant-3bit

Text Generation • 3B • Updated 1 day ago • 274

VikramPal/Qwen3.8-27B-text2sql-DynQuant-4bit

Text Generation • 4B • Updated 1 day ago • 36