https://github.com/j178/tiktoken-go-binding.git
git clone https://github.com/j178/tiktoken-go-binding.git
git clone git@github.com:j178/tiktoken-go-binding.git
gh repo clone j178/tiktoken-go-binding
A Go binding for tiktoken-rs, for tokenizing text with OpenAI models using tiktoken.
Here are some pure Go implementations you might consider using instead of this one: