lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

Package versions

52 VERSIONS IN TOTAL
versionpublisheddirect vulnerabilities
0.5.5rc42 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc32 Sep, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc231 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc128 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.420 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc520 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc415 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc315 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc213 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc112 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.35 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc45 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc23 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc11 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.222 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.2rc120 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.16 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.1rc22 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.1rc12 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.023 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities and provides fixes for free.

Get started free