pyspark.util.VersionUtils.majorMinorVersion¶

static VersionUtils.majorMinorVersion(sparkVersion: str) → Tuple[int, int][source]¶

Given a Spark version string, return the (major version number, minor version number). E.g., for 2.0.1-SNAPSHOT, return (2, 0).

Examples

>>> sparkVersion = "2.4.0"
>>> VersionUtils.majorMinorVersion(sparkVersion)
(2, 4)
>>> sparkVersion = "2.3.0-SNAPSHOT"
>>> VersionUtils.majorMinorVersion(sparkVersion)
(2, 3)

pyspark.BarrierTaskContext.taskAttemptId Resource Management