distinct {SparkR} | R Documentation |
Return a new SparkDataFrame containing the distinct rows in this SparkDataFrame.
distinct(x) ## S4 method for signature 'SparkDataFrame' distinct(x) ## S4 method for signature 'SparkDataFrame' unique(x)
x |
A SparkDataFrame |
distinct since 1.4.0
unique since 1.5.0
Other SparkDataFrame functions: SparkDataFrame-class
,
agg
, alias
,
arrange
, as.data.frame
,
attach,SparkDataFrame-method
,
broadcast
, cache
,
checkpoint
, coalesce
,
collect
, colnames
,
coltypes
,
createOrReplaceTempView
,
crossJoin
, cube
,
dapplyCollect
, dapply
,
describe
, dim
,
dropDuplicates
, dropna
,
drop
, dtypes
,
exceptAll
, except
,
explain
, filter
,
first
, gapplyCollect
,
gapply
, getNumPartitions
,
group_by
, head
,
hint
, histogram
,
insertInto
, intersectAll
,
intersect
, isLocal
,
isStreaming
, join
,
limit
, localCheckpoint
,
merge
, mutate
,
ncol
, nrow
,
persist
, printSchema
,
randomSplit
, rbind
,
rename
, repartitionByRange
,
repartition
, rollup
,
sample
, saveAsTable
,
schema
, selectExpr
,
select
, showDF
,
show
, storageLevel
,
str
, subset
,
summary
, take
,
toJSON
, unionAll
,
unionByName
, union
,
unpersist
, withColumn
,
withWatermark
, with
,
write.df
, write.jdbc
,
write.json
, write.orc
,
write.parquet
, write.stream
,
write.text
## Not run:
##D sparkR.session()
##D path <- "path/to/file.json"
##D df <- read.json(path)
##D distinctDF <- distinct(df)
## End(Not run)