pyspark.sql.DataFrame.distinct¶

DataFrame.distinct()[source]¶

Returns a new DataFrame containing the distinct rows in this DataFrame.

New in version 1.3.0.

Examples

>>> df.distinct().count()
2

pyspark.sql.DataFrame.describe pyspark.sql.DataFrame.drop