Getting Started
User Guide
API Reference
Development
Migration Guide
Spark SQL
Pandas API on Spark
Structured Streaming
Core Classes
Input/Output
Query Management
MLlib (DataFrame-based)
Spark Streaming
MLlib (RDD-based)
Spark Core
Resource Management
Structured Streaming
ΒΆ
This page gives an overview of all public Structed Streaming API.
Core Classes
pyspark.sql.streaming.DataStreamReader
pyspark.sql.streaming.DataStreamWriter
pyspark.sql.streaming.StreamingQuery
pyspark.sql.streaming.StreamingQueryManager
Input/Output
pyspark.sql.streaming.DataStreamReader.csv
pyspark.sql.streaming.DataStreamReader.format
pyspark.sql.streaming.DataStreamReader.json
pyspark.sql.streaming.DataStreamReader.load
pyspark.sql.streaming.DataStreamReader.option
pyspark.sql.streaming.DataStreamReader.options
pyspark.sql.streaming.DataStreamReader.orc
pyspark.sql.streaming.DataStreamReader.parquet
pyspark.sql.streaming.DataStreamReader.schema
pyspark.sql.streaming.DataStreamReader.text
pyspark.sql.streaming.DataStreamWriter.foreach
pyspark.sql.streaming.DataStreamWriter.foreachBatch
pyspark.sql.streaming.DataStreamWriter.format
pyspark.sql.streaming.DataStreamWriter.option
pyspark.sql.streaming.DataStreamWriter.options
pyspark.sql.streaming.DataStreamWriter.outputMode
pyspark.sql.streaming.DataStreamWriter.partitionBy
pyspark.sql.streaming.DataStreamWriter.queryName
pyspark.sql.streaming.DataStreamWriter.start
pyspark.sql.streaming.DataStreamWriter.trigger
Query Management
pyspark.sql.streaming.StreamingQuery.awaitTermination
pyspark.sql.streaming.StreamingQuery.exception
pyspark.sql.streaming.StreamingQuery.explain
pyspark.sql.streaming.StreamingQuery.id
pyspark.sql.streaming.StreamingQuery.isActive
pyspark.sql.streaming.StreamingQuery.lastProgress
pyspark.sql.streaming.StreamingQuery.name
pyspark.sql.streaming.StreamingQuery.processAllAvailable
pyspark.sql.streaming.StreamingQuery.recentProgress
pyspark.sql.streaming.StreamingQuery.runId
pyspark.sql.streaming.StreamingQuery.status
pyspark.sql.streaming.StreamingQuery.stop
pyspark.sql.streaming.StreamingQueryManager.active
pyspark.sql.streaming.StreamingQueryManager.awaitAnyTermination
pyspark.sql.streaming.StreamingQueryManager.get
pyspark.sql.streaming.StreamingQueryManager.resetTerminated
pyspark.pandas.extensions.register_index_accessor
Core Classes