Homepage

lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
Licenses: Apache-2.0
Published: 1 years ago Last updated: 10 days ago Latest version: 0.5.0
pip
GitHub

Package Health Score

69/100
  • securitySecurity issues found
  • popularitySmall
  • maintenanceHealthy
  • communityActive

Maintenance

HEALTHY

Commit Frequency

Loading chart...

Open Issues
126
Open PR
254
New PRS
1
Last Release
10 days ago
Last Commit
1 days ago
Maintainers
250

Further analysis of the maintenance status of lmcache based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that lmcache demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Popularity

SMALL
GitHub Stars
10.0k
Forks
1.4k
Contributors
250

Based on project statistics from the GitHub repository for the PyPI package lmcache, we found that it has been starred 10,024 times.

Community

ACTIVE
Readme
Yes
Contributing.md
Yes
Code of Conduct
Yes
Contributors
250
Funding
No
LICENSE
Apache-2.0

A good and healthy external contribution signal for lmcache project, which invites more than one hundred open source maintainers to collaborate on the repository.

License

Apache-2.0[0,);
Report a new vulnerability Found a mistake?

Direct Vulnerabilities

Known vulnerabilities in the lmcache package. This does not include vulnerabilities belonging to this package’s dependencies.

Fix vulnerabilities automatically

Snyk's AI Trust Platform automatically finds the best upgrade path and integrates with your development workflows. Secure your code at zero cost.

Fix for free

Security

SECURITY ISSUES FOUND
Show only direct vulnerabilities in latest version
VulnerabilityVulnerable Version
  • L
Use of Weak Hash

[0,)

Package versions

35 VERSIONS IN TOTAL See all versions
versionpublisheddirect vulnerabilities
0.5.1rc22 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.1rc12 Jul, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.023 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.5.0rc123 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8.dev4218 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8.dev3818 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8rc418 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.8rc318 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.713 Jun, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L
0.4.629 May, 2026
  • 0
    C
  • 0
    H
  • 0
    M
  • 1
    L

lmcache dependencies

25 IN TOTAL
aiofileaiofilesaiohttpawscrtblake3cachetoolscufile-pythoncupy-cuda13xfastapigoogle-api-coregoogle-cloud-bigtablehttptoolshttpxmsgspecnumbanvtxpsutilpy-cpuinfopytestpyyaml
Show more dependencies