Homepage

lmcache@0.5.1rc1

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

  • latest version

    0.5.0

  • first published

    1 years ago

  • latest version published

    10 days ago

  • licenses detected

  • View lmcache package health on Snyk  (opens in a new tab)
    • Go back to all versions of this package
    Report a new vulnerability Found a mistake?

    Direct Vulnerabilities

    Known vulnerabilities in the lmcache package. This does not include vulnerabilities belonging to this package’s dependencies.

    Fix vulnerabilities automatically

    Snyk's AI Trust Platform automatically finds the best upgrade path and integrates with your development workflows. Secure your code at zero cost.

    Fix for free
    VulnerabilityVulnerable Version
    • L
    Use of Weak Hash

    lmcache is an A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

    Affected versions of this package are vulnerable to Use of Weak Hash in the hex_hash_to_int16 function of the KV Cache Handler process. An attacker can compromise data integrity or cause partial denial of service by exploiting the use of a weak hash algorithm through local access with low privileges and high attack complexity.

    How to fix Use of Weak Hash?

    A fix was pushed into the master branch but not yet published.

    [0,)
    Go back to all versions of this package