ADAPTIVE_EXECUTION_ENABLED
SQLConf
AFTSurvivalRegression
regression
AFTSurvivalRegressionModel
regression
ALLOW_MULTIPLE_CONTEXTS
SQLConf
ALS
recommendation recommendation
ALSModel
recommendation
ANY
TaskLocality
AUTO_BROADCASTJOIN_THRESHOLD
SQLConf
AbsoluteError
loss
Accumulable
spark
AccumulableInfo
scheduler v1
AccumulableParam
spark
Accumulator
spark
AccumulatorParam
spark
AccumulatorV2
util
Aggregator
spark expressions
Algo
configuration Algo
AnalysisException
sql
And
sources
AnyDataType
types
ApplicationAttemptInfo
v1
ApplicationInfo
v1
ApplicationStatus
v1
ApproxHist
QuantileStrategy
ArrayType
types
Assignment
PowerIterationClustering
AssociationRules
fpm
AsyncRDDActions
rdd
AtomicType
types
Attribute
attribute
AttributeGroup
attribute
AttributeType
attribute
abs
functions Decimal
accumUpdates
ExceptionFailure SparkListenerExecutorMetricsUpdate
accumulable
SparkContext JavaSparkContext
accumulableCollection
SparkContext
accumulables
StageInfo TaskInfo
accumulator
SparkContext JavaSparkContext
accumulatorUpdates
StageData TaskData
accuracy
MulticlassMetrics MultilabelMetrics
acos
functions
active
ContinuousQueryManager ReceiverInfo
activeJobs
JobProgressListener
activeStages
JobProgressListener
activeStorageStatusList
ExecutorsListener StorageListener
activeTasks
ExecutorSummary
add
Accumulable BlockMatrix MultivariateOnlineSummarizer StructType AccumulatorV2 DoubleAccumulator LegacyAccumulatorWrapper ListAccumulator LongAccumulator CountMinSketch
addAccumulator
AccumulableParam AccumulatorParam
addAppArgs
SparkLauncher
addBinary
CountMinSketch
addFile
SparkContext JavaSparkContext SparkLauncher
addGrid
ParamGridBuilder
addInPlace
AccumulableParam DoubleAccumulatorParam FloatAccumulatorParam IntAccumulatorParam LongAccumulatorParam
addIntercept
GeneralizedLinearAlgorithm
addJar
SparkContext JavaSparkContext SparkLauncher
addListener
SparkAppHandle ContinuousQueryManager
addLong
CountMinSketch
addPyFile
SparkLauncher
addSparkArg
SparkLauncher
addSparkListener
SparkContext
addStreamingListener
StreamingContext JavaStreamingContext
addString
CountMinSketch
addTaskCompletionListener
TaskContext
addTaskFailureListener
TaskContext
add_months
functions
address
RDDDataDistribution
agg
Dataset KeyValueGroupedDataset RelationalGroupedDataset
aggUntyped
KeyValueGroupedDataset
aggregate
JavaRDDLike RDD
aggregateByKey
JavaPairRDD PairRDDFunctions
aggregateMessages
Graph
aggregateMessagesWithActiveSet
GraphImpl
aggregateUsingIndex
VertexRDD VertexRDDImpl
aggregator
ShuffleDependency
aic
GeneralizedLinearRegressionSummary
algo
Strategy DecisionTreeModel GradientBoostedTreesModel RandomForestModel
algorithm
StreamingLogisticRegressionWithSGD StreamingLinearAlgorithm StreamingLinearRegressionWithSGD
alias
Column Dataset
alpha
WeibullGenerator
and
Column
antecedent
Rule
anyNull
Row
apache
org
api
spark sql status streaming
appAttemptId
SparkListenerApplicationStart
appId
SparkListenerApplicationStart
appName
SparkContext JavaSparkContext SparkListenerApplicationStart Builder
appendBias
MLUtils
applicationAttemptId
SparkContext
applicationId
SparkContext
apply
Graph Pregel VertexRDD GraphImpl AttributeGroup DenseMatrix DenseVector Matrix SparseMatrix Vector ParamMap DenseMatrix DenseVector Matrix SparseMatrix Vector AccumulableInfo Column Dataset ProcessingTime Row UserDefinedAggregateFunction UserDefinedFunction ArrayType Decimal MapType StructType BlockId StorageLevel Milliseconds Minutes Seconds Broker SimpleConsumerConfig OffsetRange StatCounter
applySchemaToPythonRDD
SQLContext SparkSession
approxCountDistinct
functions
approxQuantile
DataFrameStatFunctions
areaUnderPR
BinaryClassificationMetrics
areaUnderROC
BinaryLogisticRegressionSummary BinaryClassificationMetrics
argmax
DenseVector SparseVector Vector DenseVector SparseVector Vector
array
ColumnName functions
arrayLengthGt
ParamValidators
array_contains
functions
as
Column Dataset
asIterator
DeserializationStream
asKeyValueIterator
DeserializationStream
asRDDId
BlockId
asc
Column functions
ascii
functions
asin
functions
assertValid
Broadcast
assignments
PowerIterationClusteringModel
atan
functions
atan2
functions
attempt
TaskData
attemptId
StageInfo ApplicationAttemptInfo StageData
attemptNumber
TaskCommitDenied TaskContext TaskInfo
attempts
ApplicationInfo
attr
Edge EdgeContext
attrType
Attribute BinaryAttribute NominalAttribute NumericAttribute UnresolvedAttribute
attribute
ml EqualNullSafe EqualTo GreaterThan GreaterThanOrEqual In IsNotNull IsNull LessThan LessThanOrEqual StringContains StringEndsWith StringStartsWith
attributes
AttributeGroup
available
LZ4BlockInputStream
avg
RelationalGroupedDataset typed functions DoubleAccumulator LongAccumulator
avgMetrics
CrossValidatorModel
awaitAnyTermination
ContinuousQueryManager
awaitTermination
ContinuousQuery StreamingContext JavaStreamingContext
awaitTerminationOrTimeout
StreamingContext JavaStreamingContext