v0.2.1 - Fix: Prevent caching of failed BPE file downloads

What's Changed

• fix: don't cache error responses from BPE file downloads by @kuzminT in #12

Full Changelog: v0.2.0...v0.2.1

v0.2.0 – GPT-5 Model Support

• Added support for new GPT-5 model families.
• Improved testing and updated documentation.

v0.1.0 - Maintained Fork

tiktoken-go v0.1.0 - Maintained Fork

This is the release of the maintained version of tiktoken-go, continuing development of the original (now unmaintained) project.

Improvements over original:

• Added support for the latest models.
• Replaced some outdated methods.

Migration from original:

Simply update your import to:

go
import "github.com/localit-io/tiktoken-go"

Note:
This is a 0.x release - API may still change as we continue improving the library. Feedback and contributions welcome!

v0.0.1-localit

Add supports for new 4.1 and 4.5 models.