Homepage

lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
Licenses: Apache-2.0
Published: 1 years ago Last updated: 2 days ago Latest version: 0.5.3
pip
GitHub

Package Health Score

66/100
  • securitySecurity issues found
  • popularitySmall
  • maintenanceHealthy
  • communityActive

Maintenance

HEALTHY

Commit Frequency

Loading chart...

Open Issues
131
Open PR
282
New PRS
1
Last Release
2 days ago
Last Commit
18 days ago
Maintainers
260

Further analysis of the maintenance status of lmcache based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that lmcache demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Popularity

SMALL
GitHub Stars
10.8k
Forks
1.6k
Contributors
260

Based on project statistics from the GitHub repository for the PyPI package lmcache, we found that it has been starred 10,766 times.

Community

ACTIVE
Readme
Yes
Contributing.md
Yes
Code of Conduct
Yes
Contributors
260
Funding
No
LICENSE
Apache-2.0

A good and healthy external contribution signal for lmcache project, which invites more than one hundred open source maintainers to collaborate on the repository.

License

Apache-2.0[0,);
Report a new vulnerability Found a mistake?

Direct Vulnerabilities

Known vulnerabilities in the lmcache package. This does not include vulnerabilities belonging to this package’s dependencies.

Fix vulnerabilities automatically

Snyk's AI Trust Platform automatically finds the best upgrade path and integrates with your development workflows. Secure your code at zero cost.

Fix for free

Security

SECURITY ISSUES FOUND
Show only direct vulnerabilities in latest version
VulnerabilityVulnerable Version
  • L
Use of Weak Hash

[0,)

Package versions

42 VERSIONS IN TOTAL See all versions
versionpublisheddirect vulnerabilities
0.5.35 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc45 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc23 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.3rc11 Aug, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.222 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.2rc120 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.16 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.1rc22 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.1rc12 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.023 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

lmcache dependencies

26 IN TOTAL
aiofileaiofilesaiohttpawscrtblake3cachetoolscryptographycufile-pythoncupy-cuda13xfastapigoogle-api-coregoogle-cloud-bigtablehttptoolshttpxmsgspecnumbanvtxpsutilpy-cpuinfopytest
Show more dependencies