Getting Started
User Guide
API Reference
Development
Migration Guide
Spark SQL
Structured Streaming
MLlib (DataFrame-based)
Spark Streaming
MLlib (RDD-based)
Spark Core
Resource Management
pyspark.SparkContext.dump_profiles
¶
SparkContext.
dump_profiles
(
path
)
[source]
¶
Dump the profile stats into directory
path
pyspark.SparkContext.defaultParallelism
pyspark.SparkContext.emptyRDD