Repository Issues

niieani/gpt-tokenizer

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.

View on GitHub
Stars
 (836 stars)
Forks
 (60 forks)
Indexed issues
 (1 indexed issue)
open beginner issues
 (1 open beginner issue)
Latest indexed
Aug 18, 2026
Last GitHub push
Aug 16, 2026
License
MIT License
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
TypeScript
PR merge metrics
 (No merged PRs in 30d)
Beginner labels
help wanted

Issues

1 indexed issue

Open
Picture tokens
help wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this month

niieani / gpt-tokenizer · #41 · Jan 27, 2024 · TypeScript · 836 stars

3 comments1 reaction0 assignees