Module Hierarchy

• pyspark: PySpark is the Python API for Spark.
  • pyspark.accumulators:  
  • pyspark.broadcast:  
  • pyspark.conf:  
  • pyspark.context
  • pyspark.files
  • pyspark.mllib: Python bindings for MLlib.
    • pyspark.mllib.classification
    • pyspark.mllib.clustering
    • pyspark.mllib.linalg: MLlib utilities for linear algebra.
    • pyspark.mllib.random: Python package for random data generation.
    • pyspark.mllib.recommendation
    • pyspark.mllib.regression
    • pyspark.mllib.stat: Python package for statistical functions in MLlib.
    • pyspark.mllib.tree
    • pyspark.mllib.util
  • pyspark.rdd
  • pyspark.resultiterable
  • pyspark.serializers: PySpark supports custom serializers for transferring data; this can improve performance.
  • pyspark.sql
  • pyspark.statcounter
  • pyspark.storagelevel