Homepage

lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
Licenses: Apache-2.0
Published: 1 years ago Last updated: 11 days ago Latest version: 0.5.4
pip
GitHub

Package Health Score

66/100
  • securitySecurity issues found
  • popularitySmall
  • maintenanceHealthy
  • communityActive

Maintenance

HEALTHY

Commit Frequency

Loading chart...

Open Issues
131
Open PR
282
New PRS
0
Last Release
11 days ago
Last Commit
1 months ago
Maintainers
260

Further analysis of the maintenance status of lmcache based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that lmcache demonstrates a positive version release cadence with at least one new version released in the past 3 months.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Popularity

SMALL
GitHub Stars
10.8k
Forks
1.6k
Contributors
260

Based on project statistics from the GitHub repository for the PyPI package lmcache, we found that it has been starred 10,766 times.

Community

ACTIVE
Readme
Yes
Contributing.md
Yes
Code of Conduct
Yes
Contributors
260
Funding
No
LICENSE
Apache-2.0

A good and healthy external contribution signal for lmcache project, which invites more than one hundred open source maintainers to collaborate on the repository.

License

Apache-2.0[0,);
Report a new vulnerability Found a mistake?

Direct Vulnerabilities

Known vulnerabilities in the lmcache package. This does not include vulnerabilities belonging to this package’s dependencies.

Fix vulnerabilities automatically

Snyk's AI Trust Platform automatically finds the best upgrade path and integrates with your development workflows. Secure your code at zero cost.

Fix for free

Security

SECURITY ISSUES FOUND
Show only direct vulnerabilities in latest version
VulnerabilityVulnerable Version
  • L
Use of Weak Hash

[0,)

Package versions

50 VERSIONS IN TOTAL See all versions
versionpublisheddirect vulnerabilities
0.5.5rc231 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.5rc128 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.420 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc520 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc415 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc315 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc213 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.4rc112 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.35 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc45 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

lmcache dependencies

26 IN TOTAL
aiofileaiofilesaiohttpawscrtblake3cachetoolscryptographycufile-pythoncupy-cuda13xfastapigoogle-api-coregoogle-cloud-bigtablehttptoolshttpxmsgspecnumbanvtxpsutilpy-cpuinfopytest
Show more dependencies