Information Exposure Affecting scrapy package, versions [2.0.0, 2.5.1) [,1.8.1)
Threat Intelligence
Do your applications use this vulnerable package?
In a few clicks we can analyze your entire application and see what components are vulnerable in your application, and suggest you quick fixes.
Test your applications- Snyk ID SNYK-PYTHON-SCRAPY-1729576
- published 7 Oct 2021
- disclosed 6 Oct 2021
- credit Unknown
Introduced: 6 Oct 2021
CVE-2021-41125 Open this link in a new tabHow to fix?
Upgrade Scrapy to version 2.5.1, 1.8.1 or higher.
Overview
Scrapy is a high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages.
Affected versions of this package are vulnerable to Information Exposure. If you use HttpAuthMiddleware (i.e. the http_user and http_pass spider attributes) for HTTP authentication, all requests will expose your credentials to the request target. This includes requests generated by Scrapy components, such as robots.txt requests sent by Scrapy when the ROBOTSTXT_OBEY setting is set to True, or as requests reached through redirects.