lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

Package versions

35 VERSIONS IN TOTAL
versionpublisheddirect vulnerabilities
0.3.10.post28 Dec, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.10.post15 Dec, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.1028 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.9.post211 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.9.post16 Nov, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.929 Oct, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.729 Sep, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.615 Sep, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.529 Aug, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.425 Aug, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.33 Aug, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.215 Jul, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.1.post126 Jun, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.125 Jun, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.3.028 May, 2025
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities and provides fixes for free.

Get started free