In a few clicks we can analyze your entire application and see what components are vulnerable in your application, and suggest you quick fixes.
Test your applicationsUpgrade InternLM/lmdeploy to version 0.0.10 or higher.
Affected versions of this package are vulnerable to Race Condition when generating multiple requests with tensor para > 1.