pyspark.SparkContext.setJobDescription

SparkContext.setJobDescription(value: str) → None[source]

Set a human readable description of the current job.

Notes

If you run jobs in parallel, use pyspark.InheritableThread for thread local inheritance.

pyspark.SparkContext.setCheckpointDir pyspark.SparkContext.setJobGroup