@huggingface/tokenizers

🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers

Package versions

11 VERSIONS IN TOTAL
versionpublisheddirect vulnerabilities
0.2.07 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.1.318 Mar, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.1.221 Feb, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.1.130 Jan, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.1.020 Jan, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.0.614 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.0.57 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.0.44 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.0.34 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.0.23 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.0.13 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities and provides fixes for free.

Get started free