-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
mlx-community/GLM-4.6V-Flash-4bit
Image-Text-to-Text
•
Updated
•
1.07k
•
7
Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32
Text-to-Image
•
Updated
•
23.2k
•
45
huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit
Text Generation
•
353B
•
Updated
•
1.05k
•
16
mlx-community/GLM-4.6V-4bit
Image-Text-to-Text
•
Updated
•
724
•
4
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
519k
•
42
QuantTrio/DeepSeek-V3.2-AWQ
Text Generation
•
685B
•
Updated
•
2.65k
•
5
huihui-ai/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-4bit
Text Generation
•
80B
•
Updated
•
1.91k
•
3
PLOI-Labs/lh-degen-001
Updated
•
67
•
3
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
33B
•
Updated
•
60.7k
•
592
Qwen/Qwen2.5-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
8B
•
Updated
•
191k
•
95
gaunernst/gemma-3-12b-it-int4-awq
Image-Text-to-Text
•
12B
•
Updated
•
4.11k
•
22
IDEA-Research/Rex-Omni-AWQ
4B
•
Updated
•
1.92k
•
3
Disty0/FLUX.2-dev-SDNQ-uint4-svd-r32
Updated
•
645
•
11
avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16
Text Generation
•
271B
•
Updated
•
300
•
2
MaziyarPanahi/Hermes-4.3-36B-GGUF
Text Generation
•
36B
•
Updated
•
20.1k
•
2
steampunque/Ministral-3-3B-Instruct-2512-Hybrid-GGUF
3B
•
Updated
•
153
•
2
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
•
9B
•
Updated
•
15.6k
•
2
nn-tech/MetalGPT-1-AWQ
Text Generation
•
33B
•
Updated
•
79
•
2
TheBloke/Falcon-7B-Instruct-GPTQ
Text Generation
•
7B
•
Updated
•
141
•
68
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
7B
•
Updated
•
10.6k
•
267
TheBloke/13B-BlueMethod-GPTQ
Text Generation
•
13B
•
Updated
•
143
•
6
TheBloke/Octocoder-GPTQ
Text Generation
•
16B
•
Updated
•
28
•
8
jxy/Tongyi-Finance-14B-Chat-Int4
Text Generation
•
Updated
•
15
•
2
TheBloke/saiga_mistral_7b-AWQ
Text Generation
•
7B
•
Updated
•
312
•
4
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
47B
•
Updated
•
361k
•
140
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
7B
•
Updated
•
26.6k
•
55
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
7B
•
Updated
•
10.9k
•
34
unsloth/mistral-7b-instruct-v0.1-bnb-4bit
Text Generation
•
7B
•
Updated
•
536
•
7
MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
121k
•
40
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
8B
•
Updated
•
9.01k
•
40