Repository Issues

huggingface/tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

View on GitHub
Stars
 (10,972 stars)
Forks
 (1,168 forks)
Indexed issues
 (0 indexed issues)
open beginner issues
 (0 open beginner issues)
Latest indexed
Aug 14, 2026
Last GitHub push
Aug 5, 2026
License
Apache License 2.0
Contributing guide
Contributing guide
Code of conduct
No code of conduct
Dominant language
Rust
PR merge metrics
 (Avg merge 3d 7h) (14 merged PRs in 30d)
Beginner labels
No beginner labels indexed

Issues

0 closed indexed issues

No closed indexed issues found for this repository.