Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,178

Base only

Active filters: on-device

onblueroses/pnyx-habermas

Text Classification • Updated Apr 12 • 3

onblueroses/pnyx-erscheinung

Text Classification • Updated Apr 12 • 3

nuroai/Avalon-2B

Text Generation • 2B • Updated Apr 12 • 25 • 3

nuroai/Avalon-2B-GGUF

Text Generation • 2B • Updated Apr 12 • 25

BrainboxAI/cyber-analyst-4B

Text Generation • 8B • Updated 23 days ago • 842 • 5

mradermacher/Avalon-2B-GGUF

Text Generation • 2B • Updated Apr 13 • 276

mradermacher/Avalon-2B-i1-GGUF

Text Generation • 2B • Updated Apr 13 • 868

goyozoyo/taffy-0.5-70m

Text Generation • 72M • Updated Apr 13 • 16 • 1

batiai/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated Aug 16 • 68

batiai/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated May 4 • 69

soniqo/Silero-VAD-v5-LiteRT

Voice Activity Detection • Updated May 16 • 140

soniqo/WeSpeaker-ResNet34-LM-LiteRT

Audio Classification • Updated May 16 • 55

soniqo/Pyannote-Segmentation-LiteRT

Voice Activity Detection • Updated May 16 • 119

soniqo/Parakeet-TDT-0.6B-v3-LiteRT-INT8

Automatic Speech Recognition • Updated May 16 • 192

soniqo/Omnilingual-ASR-CTC-300M-LiteRT-INT8

Automatic Speech Recognition • Updated May 16 • 16

soniqo/Qwen3-ASR-0.6B-Encoder-LiteRT-INT8

Automatic Speech Recognition • Updated May 16 • 13

maxpar1/kokoro-82m-coreml

Text-to-Speech • Updated Apr 13 • 6

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 8B • Updated Apr 18 • 15.1k • 123

batiai/MiniMax-M2.7-GGUF

Text Generation • 229B • Updated Apr 15 • 65

metacortex-ai/metacortex-models

0.3B • Updated Apr 30 • 101

developerabu/Josiefied-Qwen3.5-0.8B-gabliterated-v1-MNN

Text Generation • Updated Apr 14 • 19

vilaksh01/Twin3D

Object Detection • Updated Apr 14 • 23 • 2

Outlier-Ai/Outlier-70B-V3.3

Text Generation • Updated May 5 • 11 • 1

John9007/MOSS-TTS-Local-GGUF

Text-to-Speech • 3B • Updated Apr 14 • 96 • 2

prism-ml/Ternary-Bonsai-1.7B-mlx-2bit

Text Generation • 2B • Updated Apr 18 • 1.72k • 21

younghan-meta/Parakeet-TDT-ExecuTorch-CUDA-Windows

Automatic Speech Recognition • Updated Apr 14 • 20

younghan-meta/Parakeet-TDT-ExecuTorch-CUDA-Windows-Quantized

Automatic Speech Recognition • Updated Apr 14 • 19

xhhcode/Mobile-O-0.5B

Text-to-Image • 2B • Updated Apr 15 • 11

barrydeen/nspam

Text Classification • Updated Aug 30

bzhash420/nox-gemma4-e2b-primary-litert-stable