lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

Package versions

70 VERSIONS IN TOTAL
versionpublisheddirect vulnerabilities
0.5.8rc321 Nov, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.8rc220 Nov, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.8rc113 Nov, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.7.post112 Nov, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.7rc43 Nov, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.7rc331 Oct, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.7rc227 Oct, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.615 Oct, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 0
    L
0.5.6rc512 Oct, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.6rc4.dev2710 Oct, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.6rc36 Oct, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.6rc228 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.6rc126 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.512 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc712 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc6.dev1710 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc612 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc54 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc42 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc32 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities and provides fixes for free.

Get started free