pyspark.sql.streaming.DataStreamWriter.partitionBy

DataStreamWriter.partitionBy(*cols)[source]

Partitions the output by the given columns on the file system.

If specified, the output is laid out on the file system similar to Hive’s partitioning scheme.

New in version 2.0.0.

Parameters
colsstr or list

name of columns

Notes

This API is evolving.

previous

pyspark.sql.streaming.DataStreamWriter.outputMode

next

pyspark.sql.streaming.DataStreamWriter.queryName