Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
Jellybox
JoyFusion
LocalAI
vLLM
Ollama
TGI
MLX LM
Docker Model Runner
Lemonade
Inference Providers
Select all
Groq
Novita
Nebius AI
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
Misc
Reset Misc
tokenizer
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Mixture of Experts
Carbon Emissions
Apply filters
Models
316
Full-text search
Inference Available
Edit filters
Sort: Trending
Active filters:
tokenizer
Clear all
Johnnyman1100/EZ-Tokenizer
Token Classification
•
Updated
May 30, 2025
mrcha033/YunMin-tokenizer-96k
Text Generation
•
Updated
May 28, 2025
•
7
Hailay/MachineT_TigEng
76.5M
•
Updated
Sep 24, 2025
•
53
•
1
LocalDoc/az-en-unigram-tokenizer-50k
Updated
May 30, 2025
•
1
bxod/Llama-3.2-1B-Instruct-uz
Text Generation
•
1B
•
Updated
Jun 2, 2025
•
20
•
4
bxod/Llama-3.2-3B-Instruct-uz
Text Generation
•
3B
•
Updated
Jun 2, 2025
•
12
•
5
Bochkov/bvv241-2-3
Feature Extraction
•
Updated
Oct 20, 2025
•
7
Bochkov/bvv241-nemo
Feature Extraction
•
Updated
Oct 20, 2025
•
6
Bochkov/bvv241-abs
Feature Extraction
•
Updated
Oct 20, 2025
•
7
helmo/code-search-net-multilang-tokenizer
Updated
Jun 14, 2025
alakxender/bert-fast-dhivehi-tokenizer-extended
Token Classification
•
Updated
Jun 15, 2025
Noctiro/Randeng-T5-784M-MultiTask-Chinese-with-tokenizer-json
0.8B
•
Updated
Jun 18, 2025
•
9
abakirci/admbkrc-turkish-tokenizer
Updated
Jun 18, 2025
•
1
Vipplav/telugu-bpe-23k
Updated
Jun 19, 2025
metythorn/xlm-roberta-tokenizer-10k
Updated
Jul 10, 2025
goabonga/wikitext-2-raw-v1
Token Classification
•
Updated
Jun 30, 2025
metythorn/xlm-roberta-tokenizer-50k
Updated
Jul 10, 2025
ZombitX64/Thaitokenizer
Updated
Aug 22, 2025
metythorn/xlm-roberta-tokenizer-100k
Updated
Jul 10, 2025
luispintoc/MoleBERT-Tokenizer-Hf-TMC_scratch_150k_30ep
2.17M
•
Updated
Jul 17, 2025
•
5
jjiaweiyang/l-DeTok
Image Feature Extraction
•
Updated
Aug 6, 2025
•
1
luispintoc/MoleBERT-Tokenizer-Hf-TMC_scratch_530k_30ep
2.17M
•
Updated
Jul 22, 2025
•
4
amirhofo/Persian-BPE-Tokenizer
Updated
Jul 24, 2025
yakul259/english-wordpiece-tokenizer-60k
Updated
Aug 14, 2025
yakul259/english-unigram-tokenizer-60k
Updated
Aug 14, 2025
yakul259/english-bpe-tokenizer-60k
Updated
Aug 14, 2025
yakul259/finance-bpe-tokenizer-30k
Updated
Aug 15, 2025
yakul259/finance-wordpiece-tokenizer-30k
Updated
Aug 15, 2025
yakul259/finance-unigram-tokenizer-30k
Updated
Aug 15, 2025
khopilot/km-tokenizer-khmer
Feature Extraction
•
Updated
Aug 21, 2025
•
5
•
3
Previous
1
2
3
4
5
...
11
Next