Information Exposure Affecting pyspark package, versions [,2.3.3)


Severity

Recommended
0.0
medium
0
10

CVSS assessment made by Snyk's Security Team. Learn more

Threat Intelligence

EPSS
0.12% (48th percentile)

Do your applications use this vulnerable package?

In a few clicks we can analyze your entire application and see what components are vulnerable in your application, and suggest you quick fixes.

Test your applications
  • Snyk IDSNYK-PYTHON-PYSPARK-570764
  • published8 Aug 2019
  • disclosed7 Aug 2019
  • creditThomas Graves

Introduced: 7 Aug 2019

CVE-2019-10099  (opens in a new tab)
CWE-200  (opens in a new tab)

How to fix?

Upgrade pyspark to version 2.3.3 or higher.

Overview

pyspark is a fast and general cluster computing system for Big Data.

Affected versions of this package are vulnerable to Information Exposure. In certain situations Spark would write user data to local disk unencrypted, even if spark.io.encryption.enabled=true. This includes cached blocks that are fetched to disk (controlled by spark.maxRemoteBlockSizeFetchToMem); in SparkR, using parallelize; in Pyspark, using broadcast and parallelize; and use of python udfs.

CVSS Scores

version 3.1