Homepage

tokenizers vulnerabilities

Licenses: Apache-2.0
Published: 6 years ago Last updated: 2 months ago Latest version: 0.22.1 Latest non-vulnerable version: 0.22.1
pip
GitHub

Package Health Score

94/100
  • securityNo known security issues
  • popularityKey ecosystem project
  • maintenanceHealthy
  • communityActive

Maintenance

HEALTHY

Commit Frequency

Loading chart...

Open Issues
93
Open PR
30
New PRS
1
Last Release
2 months ago
Last Commit
1 months ago
Maintainers
120

Further analysis of the maintenance status of tokenizers based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that tokenizers demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Popularity

KEY ECOSYSTEM PROJECT
GitHub Stars
10.2k
Forks
997
Contributors
120

Based on project statistics from the GitHub repository for the PyPI package tokenizers, we found that it has been starred 10,234 times.

Community

ACTIVE
Readme
Yes
Contributing.md
No
Code of Conduct
No
Contributors
120
Funding
No
LICENSE
Apache-2.0

A good and healthy external contribution signal for tokenizers project, which invites more than one hundred open source maintainers to collaborate on the repository.

We found a way for you to contribute to the project! Looks like tokenizers is missing a Code of Conduct.

License

Apache-2.0[0,);
Report a new vulnerability Found a mistake?

Direct Vulnerabilities

No direct vulnerabilities have been found for this package in Snykā€™s vulnerability database. This does not include vulnerabilities belonging to this packageā€™s dependencies.

Does your project rely on vulnerable package dependencies?

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities (in both your packages & their dependencies) and provides automated fixes for free.

Scan for indirect vulnerabilities

Security

NO KNOWN SECURITY ISSUES
Show only direct vulnerabilities in latest version

No vulnerabilities found in the latest version

No vulnerabilities found

Package versions

99 VERSIONS IN TOTAL See all versions
versionpublisheddirect vulnerabilities
0.22.119 Sep, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.22.1rc019 Sep, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.22.029 Aug, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.22.0rc029 Aug, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.21.428 Jul, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.21.224 Jun, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.21.2rc024 Jun, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.21.113 Mar, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.21.1rc012 Mar, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.21.027 Nov, 2024
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L