The latest version of tiktoken is 1.0.3-0.
tiktoken
Version 1.0.0 revision 0 uploaded by GabrielGonzalez.
Package meta
- Synopsis
- Haskell implementation of tiktoken
- Description
This packages only implements tokenization. In other words, given an existing encoding (cl100k_base) you can tokenize an input.
- Author
- Gabriella Gonzalez
- Bug reports
- n/a
- Category
- n/a
- Copyright
- n/a
- Homepage
- n/a
- Maintainer
- GenuineGabriella@gmail.com
- Package URL
- n/a
- Stability
- n/a