lib:tiktoken

Modules

• Tiktoken

Dependencies

• base lib:base >=4.18.0.0 && <5
• base64 lib:base64 >=1.0 && <1.1
• bytestring lib:bytestring >=0.11.3.0
• containers lib:containers >=0.5.0.0
• deepseq lib:deepseq >=1.4.0.0
• filepath lib:filepath >=0
• megaparsec lib:megaparsec <9.7
• pcre-light lib:pcre-light >=0.2
• raw-strings-qq lib:raw-strings-qq >=0
• text lib:text >=0
• transformers lib:transformers >=0.2.0.0
• unordered-containers lib:unordered-containers >=0
• vector lib:vector <0.14

Reverse dependencies

Direct only. Not exhaustive.

• tiktoken bench:benchmark
• tiktoken test:tasty