write.df {SparkR}R Documentation

Save the contents of the DataFrame to a data source

Description

The data source is specified by the 'source' and a set of options (...). If 'source' is not specified, the default data source configured by spark.sql.sources.default will be used.

Usage

## S4 method for signature 'DataFrame,character'
write.df(df, path, source = NULL,
  mode = "append", ...)

## S4 method for signature 'DataFrame,character'
saveDF(df, path, source = NULL,
  mode = "append", ...)

write.df(df, path, ...)

saveDF(df, path, ...)

Arguments

df

A SparkSQL DataFrame

path

A name for the table

source

A name for external data source

mode

One of 'append', 'overwrite', 'error', 'ignore' save mode

Details

Additionally, mode is used to specify the behavior of the save operation when data already exists in the data source. There are four modes:
append: Contents of this DataFrame are expected to be appended to existing data.
overwrite: Existing data is expected to be overwritten by the contents of this DataFrame.
error: An exception is expected to be thrown.
ignore: The save operation is expected to not save the contents of the DataFrame and to not change the existing data.

Examples

## Not run: 
##D sc <- sparkR.init()
##D sqlContext <- sparkRSQL.init(sc)
##D path <- "path/to/file.json"
##D df <- jsonFile(sqlContext, path)
##D write.df(df, "myfile", "parquet", "overwrite")
##D saveDF(df, parquetPath2, "parquet", mode = saveMode, mergeSchema = mergeSchema)
## End(Not run)
[Package SparkR version 1.5.2 Index]