Repository Issues

niieani/gpt-tokenizer

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.

View on GitHub
Stars
 (834 stars)
Forks
 (60 forks)
Indexed issues
 (1 indexed issue)
open beginner issues
 (1 open beginner issue)
Latest indexed
Aug 11, 2026
Last GitHub push
Feb 10, 2026
License
MIT License
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
TypeScript
PR merge metrics
 (No merged PRs in 30d)
Beginner labels
help wanted

Issues

1 open indexed issue

Open
Picture tokens
help wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label

niieani / gpt-tokenizer · #41 · Jan 27, 2024 · TypeScript · 834 stars

3 comments1 reaction0 assignees