vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Package versions

102 VERSIONS IN TOTAL
versionpublisheddirect vulnerabilities
0.1.020 Jun, 2023
  • 3
    C
  • 46
    H
  • 25
    M
  • 6
    L
0.0.119 Jun, 2023
  • 3
    C
  • 45
    H
  • 24
    M
  • 6
    L

Automatically find and fix vulnerabilities affecting your projects. Snyk scans for vulnerabilities and provides fixes for free.

Get started free