lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

Package versions

35 VERSIONS IN TOTAL
versionpublisheddirect vulnerabilities
0.5.1rc22 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.1rc12 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.023 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.0rc123 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8.dev4218 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8.dev3818 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8rc418 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8rc318 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.713 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.629 May, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.515 May, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.423 Apr, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.37 Apr, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.218 Mar, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.112 Mar, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.152 Mar, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.1417 Feb, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.1329 Jan, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.125 Jan, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.1115 Dec, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities and provides fixes for free.

Get started free