tiktoken
PyPI19k GitHub starsv0.14.0 · Aug 2026 · License: unresolved in metadata
pip install tiktoken- No known CVEs
- 274.9M downloads/mo
- 20 versions
Description
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Licenses
Declared license
License: unresolved in metadata
Transitive dependency licenses
This package's dependency tree includes MPL-2.0, which may require you to publish changes to that component when you distribute.
| License | Category | Dependencies |
|---|---|---|
| MIT | Permissive | 2 of 6 |
| Apache-2.0 | Permissive | 1 of 6 |
| BSD-3-Clause | Permissive | 1 of 6 |
| MPL-2.0 | Weak copyleft | 1 of 6 |
| Apache-2.0 AND CNRI-Python | Unknown | 1 of 6 |
This view is derived from declared package metadata, and a full FOSSA scan detects licenses that declared metadata misses. Scan free.
License and vulnerability information on this page is derived from public package metadata and public advisory databases. It is not legal advice, and it reflects the top-level declared license only. Verify the license and terms of any software for your own needs.
Need tiktoken approved? Get the full license and vulnerability report for your codebase. Scan free.
Scan freeVulnerabilities
No known CVEs across published versions
Version history
| Version | Published |
|---|---|
| 0.14.0 | Aug 2026 |
| 0.13.0 | May 2026 |
| 0.12.0 | Oct 2025 |
| 0.11.0 | Aug 2025 |
| 0.10.0 | Aug 2025 |
| 0.9.0 | Feb 2025 |
| 0.8.0 | Oct 2024 |
| 0.7.0 | May 2024 |
| 0.6.0 | Feb 2024 |
| 0.5.2 | Dec 2023 |
| 0.5.1 | Sep 2023 |
| 0.5.0 | Sep 2023 |
| 0.4.0 | May 2023 |
| 0.3.3 | Mar 2023 |
| 0.3.2 | Mar 2023 |
| 0.3.1 | Mar 2023 |
| 0.3.0 | Mar 2023 |
| 0.2.0 | Feb 2023 |
| 0.1.2 | Jan 2023 |
| 0.1.1 | Dec 2022 |
pip install tiktoken resolves to the 0.x line today. Older major lines may still receive fixes.
Dependencies
Direct dependencies
2 direct dependencies, 6 in total including transitive. Licenses across the full tree are summarized under Licenses.
| Package | Version range | License |
|---|---|---|
| regex | Apache-2.0 AND CNRI-Python | |
| requests | Apache-2.0 |
Dependents
- litellm
- sglang
- langchain-openai
Based on what each package declares in its published metadata. The dependencies your build actually installs can differ, and a FOSSA scan of your project resolves the full tree.
Popularity
- Downloads last month
- 274.9M
- Known dependents in this corpus
- 12,234
- GitHub stars
- 19k
- OpenSSF score
- 4.2 / 10
FAQ
- What is the latest version of tiktoken?
- The latest version of tiktoken is 0.14.0, published August 2026.
- What license is tiktoken under?
- tiktoken has no resolvable license in its published metadata. FOSSA's full scan detects licenses that declared metadata misses.
- Does tiktoken have known vulnerabilities?
- No known CVEs are recorded against published versions of tiktoken.
- How do I install tiktoken?
- Install tiktoken with pip install tiktoken.
- How do I generate an SBOM that includes tiktoken?
- FOSSA's SBOM generator produces SPDX or CycloneDX output for a codebase that includes tiktoken. Generate an SPDX or CycloneDX SBOM free.