SCHEMA_STRING_LENGTH_THRESHOLD
StaticSQLConf
SHORT
Encoders
SHUFFLE
BlockId
SHUFFLE_DATA
BlockId
SHUFFLE_INDEX
BlockId
SHUFFLE_MIN_NUM_POSTSHUFFLE_PARTITIONS
SQLConf
SHUFFLE_PARTITIONS
SQLConf
SHUFFLE_TARGET_POSTSHUFFLE_INPUT_SIZE
SQLConf
SPARK_BRANCH
spark
SPARK_BUILD_DATE
spark
SPARK_BUILD_USER
spark
SPARK_REPO_URL
spark
SPARK_REVISION
spark
SPARK_SQL_PREFIX
HiveExternalCatalog
SPARK_VERSION
spark
SPMap
ShortestPaths
SQLConf
internal
SQLContext
sql
SQLDataTypes
linalg
SQLImplicits
sql
SQLTransformer
feature
SQLUserDefinedType
types
STATE_STORE_MIN_DELTAS_FOR_SNAPSHOT
SQLConf
STATISTICS_COL_STATS_PREFIX
HiveExternalCatalog
STATISTICS_NUM_ROWS
HiveExternalCatalog
STATISTICS_PREFIX
HiveExternalCatalog
STATISTICS_TOTAL_SIZE
HiveExternalCatalog
STREAM
BlockId
STREAMING_FILE_COMMIT_PROTOCOL_CLASS
SQLConf
STREAMING_METRICS_ENABLED
SQLConf
STREAMING_NO_DATA_PROGRESS_EVENT_INTERVAL
SQLConf
STREAMING_POLLING_DELAY
SQLConf
STREAMING_PROGRESS_RETENTION
SQLConf
STREAMING_SCHEMA_INFERENCE
SQLConf
STRING
Encoders
SUBEXPRESSION_ELIMINATION_ENABLED
SQLConf
SVDPlusPlus
lib
SVMDataGenerator
util
SVMModel
classification
SVMWithSGD
classification
SYSTEM_DEFAULT
DecimalType
SaveMode
sql
Saveable
util
SchedulingMode
scheduler SchedulingMode
SchemaRelationProvider
sources
ScriptTransformation
execution
Seconds
streaming
SequenceFileRDDFunctions
rdd
SerializableWritable
spark
SerializationStream
serializer
Serializer
serializer
SerializerInstance
serializer
SharedState
internal
ShortType
types
ShortestPaths
lib
ShuffleBlockId
storage
ShuffleDataBlockId
storage
ShuffleDependency
spark
ShuffleIndexBlockId
storage
ShuffleReadMetricDistributions
v1
ShuffleReadMetrics
v1
ShuffleWriteMetricDistributions
v1
ShuffleWriteMetrics
v1
ShuffledRDD
rdd
SimpleConsumerConfig
KafkaCluster
SimpleFutureAction
spark
SimpleUpdater
optimization
SingularValueDecomposition
linalg
SinkProgress
streaming
SizeEstimator
util
SnappyCompressionCodec
io
Sort
QuantileStrategy
SourceProgress
streaming
SparkAppHandle
launcher
SparkConf
spark
SparkContext
spark
SparkEnv
spark
SparkException
spark
SparkExecutorInfo
spark
SparkFiles
spark
SparkFirehoseListener
spark
SparkFlumeEvent
flume
SparkHadoopMapRedUtil
mapred
SparkJobInfo
spark
SparkLauncher
launcher
SparkListener
scheduler
SparkListenerApplicationEnd
scheduler
SparkListenerApplicationStart
scheduler
SparkListenerBlockManagerAdded
scheduler
SparkListenerBlockManagerRemoved
scheduler
SparkListenerBlockUpdated
scheduler
SparkListenerEnvironmentUpdate
scheduler
SparkListenerEvent
scheduler
SparkListenerExecutorAdded
scheduler
SparkListenerExecutorMetricsUpdate
scheduler
SparkListenerExecutorRemoved
scheduler
SparkListenerJobEnd
scheduler
SparkListenerJobStart
scheduler
SparkListenerStageCompleted
scheduler
SparkListenerStageSubmitted
scheduler
SparkListenerTaskEnd
scheduler
SparkListenerTaskGettingResult
scheduler
SparkListenerTaskStart
scheduler
SparkListenerUnpersistRDD
scheduler
SparkSession
sql
SparkStageInfo
spark
SparkStatusTracker
spark
SparseMatrix
linalg linalg
SparseVector
linalg linalg
Split
tree model
SplitInfo
scheduler
SquaredError
loss
SquaredL2Updater
optimization
StageAttemptId
JobProgressListener
StageData
v1
StageId
JobProgressListener
StageInfo
scheduler
StageStatus
v1
StandardNormalGenerator
random
StandardScaler
feature feature
StandardScalerModel
feature feature
StatCounter
util
State
SparkAppHandle streaming
StateOperatorProgress
streaming
StateSpec
streaming
StaticSQLConf
internal
Statistics
stat
StatsReportListener
scheduler scheduler
StopWordsRemover
feature
StorageLevel
storage
StorageLevels
java
StorageListener
storage
StorageStatus
storage
StorageStatusListener
storage
Strategy
configuration sql
StreamBlockId
storage
StreamInputInfo
scheduler
StreamSinkProvider
sources
StreamSourceProvider
sources
StreamingContext
streaming
StreamingContextState
streaming
StreamingKMeans
clustering
StreamingKMeansModel
clustering
StreamingLinearAlgorithm
regression
StreamingLinearRegressionWithSGD
regression
StreamingListener
scheduler
StreamingListenerBatchCompleted
scheduler
StreamingListenerBatchStarted
scheduler
StreamingListenerBatchSubmitted
scheduler
StreamingListenerEvent
scheduler
StreamingListenerOutputOperationCompleted
scheduler
StreamingListenerOutputOperationStarted
scheduler
StreamingListenerReceiverError
scheduler
StreamingListenerReceiverStarted
scheduler
StreamingListenerReceiverStopped
scheduler
StreamingLogisticRegressionWithSGD
classification
StreamingQuery
streaming
StreamingQueryException
streaming
StreamingQueryListener
streaming
StreamingQueryManager
streaming
StreamingQueryProgress
streaming
StreamingQueryStatus
streaming
StreamingTest
test
StringArrayParam
param
StringContains
sources
StringEndsWith
sources
StringIndexer
feature
StringIndexerModel
feature
StringStartsWith
sources
StringToColumn
SQLImplicits
StringType
types
StronglyConnectedComponents
lib
StructField
types
StructType
types
Success
spark
s
SingularValueDecomposition
sample
JavaDoubleRDD JavaPairRDD JavaRDD RDD Dataset BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler
sampleBy
DataFrameStatFunctions
sampleByKey
JavaPairRDD PairRDDFunctions
sampleByKeyExact
JavaPairRDD PairRDDFunctions
sampleStdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
sampleVariance
JavaDoubleRDD DoubleRDDFunctions StatCounter
save
MLWritable MLWriter LogisticRegressionModel NaiveBayesModel SVMModel BisectingKMeansModel DistributedLDAModel GaussianMixtureModel KMeansModel LocalLDAModel PowerIterationClusteringModel ChiSqSelectorModel Word2VecModel FPGrowthModel PrefixSpanModel MatrixFactorizationModel IsotonicRegressionModel LassoModel LinearRegressionModel RidgeRegressionModel DecisionTreeModel GradientBoostedTreesModel RandomForestModel Saveable DataFrameWriter
saveAsHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsHadoopFile
JavaPairRDD PairRDDFunctions
saveAsHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsLibSVMFile
MLUtils
saveAsNewAPIHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFile
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsObjectFile
JavaRDDLike RDD
saveAsObjectFiles
DStream
saveAsSequenceFile
SequenceFileRDDFunctions
saveAsTable
DataFrameWriter
saveAsTextFile
JavaRDDLike RDD
saveAsTextFiles
DStream
saveImpl
MLWriter
sc
JavaSparkContext StringToColumn
scalaBoolean
Encoders
scalaByte
Encoders
scalaDouble
Encoders
scalaFloat
Encoders
scalaInt
Encoders
scalaIntToJavaLong
JavaDStreamLike
scalaLong
Encoders
scalaShort
Encoders
scalaToJavaLong
JavaPairDStream
scalalang
expressions
scale
AFTSurvivalRegressionModel GammaGenerator Decimal DecimalType
scalingVec
ElementwiseProduct ElementwiseProduct
scheduler
spark streaming
schedulingDelay
BatchInfo
schedulingMode
JobProgressListener
schedulingPool
StageData
schema
DataFrameReader Dataset Encoder Row BaseRelation DataStreamReader
schemaLess
HiveScriptIOSchema
scope
RDDInfo
scoreAndLabels
BinaryClassificationMetrics
script
ScriptTransformation
second
functions
seconds
Durations
security
spark
securityManager
SparkEnv
seedBrokers
SimpleConsumerConfig
select
Dataset
selectExpr
Dataset
selectUntyped
Dataset
selectedFeatures
ChiSqSelectorModel ChiSqSelectorModel
selectorType
ChiSqSelector
sendToDst
EdgeContext
sendToSrc
EdgeContext
sequence
FreqSequence
sequenceFile
SparkContext JavaSparkContext
serde
HiveSerDe
serialize
VectorUDT DummySerializerInstance SerializerInstance
serializeStream
DummySerializerInstance SerializerInstance
serializer
ShuffleDependency SparkEnv spark
serializerManager
SparkEnv
session
MLReader MLWriter
sessionState
HiveContext
set
SparkConf SparkEnv EdgeTriplet Params RuntimeConfig Decimal
setActive
SQLContext
setActiveSession
SparkSession
setAggregationDepth
LogisticRegression AFTSurvivalRegression LinearRegression
setAggregator
ShuffledRDD
setAlgo
Strategy
setAll
SparkConf
setAlpha
ALS LDA ALS
setAppName
SparkConf SparkLauncher
setAppResource
SparkLauncher
setBandwidth
KernelDensity
setBeta
LDA
setBinary
CountVectorizer CountVectorizerModel HashingTF HashingTF
setBlockSize
MultilayerPerceptronClassifier
setBlocks
ALS
setBucketLength
BucketedRandomProjectionLSH
setCacheNodeIds
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor
setCallSite
SparkContext JavaSparkContext
setCaseSensitive
StopWordsRemover
setCategoricalFeaturesInfo
Strategy
setCensorCol
AFTSurvivalRegression
setCheckpointDir
SparkContext JavaSparkContext
setCheckpointInterval
DecisionTreeClassifier GBTClassifier RandomForestClassifier LDA ALS DecisionTreeRegressor GBTRegressor RandomForestRegressor LDA ALS Strategy
setClassifier
OneVsRest
setConf
SparkLauncher SQLContext
setConsumerOffsetMetadata
KafkaCluster
setConsumerOffsets
KafkaCluster
setConvergenceTol
GaussianMixture GradientDescent LBFGS StreamingLinearRegressionWithSGD
setCurrentDatabase
Catalog CatalogImpl
setDecayFactor
StreamingKMeans
setDefault
Params
setDefaultClassLoader
Serializer
setDefaultSession
SparkSession
setDegree
PolynomialExpansion
setDeployMode
SparkLauncher
setDocConcentration
LDA LDA
setDropLast
OneHotEncoder
setElasticNetParam
LogisticRegression LinearRegression
setEpsilon
KMeans
setEstimator
CrossValidator TrainValidationSplit
setEstimatorParamMaps
CrossValidator TrainValidationSplit
setEvaluator
CrossValidator TrainValidationSplit
setExecutorEnv
SparkConf
setFamily
LogisticRegression GeneralizedLinearRegression
setFeatureIndex
IsotonicRegression IsotonicRegressionModel
setFeatureSubsetStrategy
RandomForestClassifier RandomForestRegressor
setFeaturesCol
PredictionModel Predictor OneVsRest OneVsRestModel BisectingKMeans BisectingKMeansModel GaussianMixture GaussianMixtureModel KMeans KMeansModel LDA LDAModel ChiSqSelector ChiSqSelectorModel RFormula AFTSurvivalRegression AFTSurvivalRegressionModel IsotonicRegression IsotonicRegressionModel
setFinalRDDStorageLevel
ALS
setFinalStorageLevel
ALS
setFitIntercept
LogisticRegression AFTSurvivalRegression GeneralizedLinearRegression LinearRegression
setForceIndexLabel
RFormula
setFormula
RFormula
setFpr
ChiSqSelector ChiSqSelector
setGaps
RegexTokenizer
setGradient
GradientDescent LBFGS
setHalfLife
StreamingKMeans
setHandleInvalid
Bucketizer QuantileDiscretizer StringIndexer StringIndexerModel
setHashAlgorithm
HashingTF
setIfMissing
SparkConf
setImplicitPrefs
ALS ALS
setImpurity
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setIndices
VectorSlicer
setInitMode
KMeans
setInitSteps
KMeans
setInitialCenters
StreamingKMeans
setInitialModel
GaussianMixture KMeans
setInitialWeights
MultilayerPerceptronClassifier StreamingLogisticRegressionWithSGD StreamingLinearRegressionWithSGD
setInitializationMode
KMeans PowerIterationClustering
setInitializationSteps
KMeans
setInputCol
UnaryTransformer Binarizer BucketedRandomProjectionLSH Bucketizer CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString MaxAbsScaler MaxAbsScalerModel MinHashLSH MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel QuantileDiscretizer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel
setInputCols
Interaction VectorAssembler
setIntercept
GeneralizedLinearAlgorithm
setIntermediateRDDStorageLevel
ALS
setIntermediateStorageLevel
ALS
setInverse
DCT
setIsotonic
IsotonicRegression IsotonicRegression
setItemCol
ALS ALSModel
setIterations
ALS
setJars
SparkConf
setJavaHome
SparkLauncher
setJobDescription
SparkContext
setJobGroup
SparkContext JavaSparkContext
setK
BisectingKMeans GaussianMixture KMeans LDA PCA BisectingKMeans GaussianMixture KMeans LDA PowerIterationClustering StreamingKMeans
setKappa
OnlineLDAOptimizer
setKeepLastCheckpoint
LDA EMLDAOptimizer
setKeyOrdering
ShuffledRDD
setLabelCol
Predictor OneVsRest BinaryClassificationEvaluator MulticlassClassificationEvaluator RegressionEvaluator ChiSqSelector RFormula AFTSurvivalRegression IsotonicRegression
setLabels
IndexToString
setLambda
NaiveBayes ALS
setLayers
MultilayerPerceptronClassifier
setLearningDecay
LDA
setLearningOffset
LDA
setLearningRate
Word2Vec BoostingStrategy
setLink
GeneralizedLinearRegression
setLinkPredictionCol
GeneralizedLinearRegression GeneralizedLinearRegressionModel
setLocalProperty
SparkContext JavaSparkContext
setLogLevel
SparkContext JavaSparkContext
setLoss
BoostingStrategy
setLossType
GBTClassifier GBTRegressor
setMainClass
SparkLauncher
setMapSideCombine
ShuffledRDD
setMaster
SparkConf SparkLauncher
setMax
MinMaxScaler MinMaxScalerModel
setMaxBins
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxCategories
VectorIndexer
setMaxDepth
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxIter
GBTClassifier LogisticRegression MultilayerPerceptronClassifier BisectingKMeans GaussianMixture KMeans LDA Word2Vec ALS AFTSurvivalRegression GBTRegressor GeneralizedLinearRegression LinearRegression
setMaxIterations
BisectingKMeans GaussianMixture KMeans LDA PowerIterationClustering
setMaxLocalProjDBSize
PrefixSpan
setMaxMemoryInMB
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxPatternLength
PrefixSpan
setMaxSentenceLength
Word2Vec Word2Vec
setMetricName
BinaryClassificationEvaluator MulticlassClassificationEvaluator RegressionEvaluator
setMin
MinMaxScaler MinMaxScalerModel
setMinConfidence
AssociationRules
setMinCount
Word2Vec Word2Vec
setMinDF
CountVectorizer
setMinDivisibleClusterSize
BisectingKMeans BisectingKMeans
setMinDocFreq
IDF
setMinInfoGain
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinInstancesPerNode
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinSupport
FPGrowth PrefixSpan
setMinTF
CountVectorizer CountVectorizerModel
setMinTokenLength
RegexTokenizer
setMiniBatchFraction
StreamingLogisticRegressionWithSGD OnlineLDAOptimizer GradientDescent StreamingLinearRegressionWithSGD
setModelType
NaiveBayes NaiveBayes
setN
NGram
setName
JavaDoubleRDD JavaPairRDD JavaRDD EdgeRDDImpl VertexRDDImpl RDD
setNames
VectorSlicer
setNonnegative
ALS ALS
setNumBlocks
ALS
setNumBuckets
QuantileDiscretizer
setNumClasses
LogisticRegressionWithLBFGS Strategy
setNumCorrections
LBFGS
setNumFeatures
HashingTF
setNumFolds
CrossValidator
setNumHashTables
BucketedRandomProjectionLSH MinHashLSH
setNumItemBlocks
ALS
setNumIterations
StreamingLogisticRegressionWithSGD Word2Vec GradientDescent LBFGS StreamingLinearRegressionWithSGD BoostingStrategy
setNumPartitions
Word2Vec Word2Vec FPGrowth
setNumTopFeatures
ChiSqSelector ChiSqSelector
setNumTrees
RandomForestClassifier RandomForestRegressor
setNumUserBlocks
ALS
setOptimizeDocConcentration
LDA OnlineLDAOptimizer
setOptimizer
LDA LDA
setOrNull
Decimal
setOutputCol
UnaryTransformer Binarizer BucketedRandomProjectionLSH Bucketizer ChiSqSelector ChiSqSelectorModel CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString Interaction MaxAbsScaler MaxAbsScalerModel MinHashLSH MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel QuantileDiscretizer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel VectorAssembler VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel
setP
Normalizer
setParent
Model
setPattern
RegexTokenizer
setPeacePeriod
StreamingTest
setPercentile
ChiSqSelector ChiSqSelector
setPredictionCol
PredictionModel Predictor OneVsRest OneVsRestModel BisectingKMeans BisectingKMeansModel GaussianMixture GaussianMixtureModel KMeans KMeansModel MulticlassClassificationEvaluator RegressionEvaluator ALS ALSModel AFTSurvivalRegression AFTSurvivalRegressionModel IsotonicRegression IsotonicRegressionModel
setProbabilityCol
ProbabilisticClassificationModel ProbabilisticClassifier GaussianMixture GaussianMixtureModel
setProductBlocks
ALS
setPropertiesFile
SparkLauncher
setQuantileCalculationStrategy
Strategy
setQuantileProbabilities
AFTSurvivalRegression AFTSurvivalRegressionModel
setQuantilesCol
AFTSurvivalRegression AFTSurvivalRegressionModel
setRandomCenters
StreamingKMeans
setRank
ALS ALS
setRatingCol
ALS
setRawPredictionCol
ClassificationModel Classifier BinaryClassificationEvaluator
setRegParam
LogisticRegression ALS GeneralizedLinearRegression LinearRegression StreamingLogisticRegressionWithSGD GradientDescent LBFGS StreamingLinearRegressionWithSGD
setRelativeError
QuantileDiscretizer
setRuns
KMeans
setSample
KernelDensity
setScalingVec
ElementwiseProduct
setSeed
DecisionTreeClassifier GBTClassifier MultilayerPerceptronClassifier RandomForestClassifier BisectingKMeans GaussianMixture KMeans LDA LDAModel BucketedRandomProjectionLSH MinHashLSH Word2Vec ALS DecisionTreeRegressor GBTRegressor RandomForestRegressor CrossValidator TrainValidationSplit BisectingKMeans GaussianMixture KMeans LDA Word2Vec ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator StandardNormalGenerator UniformGenerator WeibullGenerator ALS BernoulliCellSampler BernoulliSampler PoissonSampler Pseudorandom
setSelectorType
ChiSqSelector ChiSqSelector
setSerializer
CoGroupedRDD ShuffledRDD
setSmoothing
NaiveBayes
setSolver
MultilayerPerceptronClassifier GeneralizedLinearRegression LinearRegression
setSparkHome
SparkConf SparkLauncher
setSplits
Bucketizer
setStages
Pipeline
setStandardization
LogisticRegression LinearRegression
setStatement
SQLTransformer
setStepSize
GBTClassifier MultilayerPerceptronClassifier Word2Vec GBTRegressor StreamingLogisticRegressionWithSGD GradientDescent StreamingLinearRegressionWithSGD
setStopWords
StopWordsRemover
setSubsamplingRate
GBTClassifier RandomForestClassifier LDA GBTRegressor RandomForestRegressor Strategy
setTaskContext
TaskContext
setTau0
OnlineLDAOptimizer
setTestMethod
StreamingTest
setThreshold
LogisticRegression LogisticRegressionModel Binarizer LogisticRegressionModel SVMModel
setThresholds
LogisticRegression LogisticRegressionModel ProbabilisticClassificationModel ProbabilisticClassifier
setToLowercase
RegexTokenizer
setTol
LogisticRegression MultilayerPerceptronClassifier GaussianMixture KMeans AFTSurvivalRegression GeneralizedLinearRegression LinearRegression
setTopicConcentration
LDA LDA
setTopicDistributionCol
LDA
setTrainRatio
TrainValidationSplit
setTreeStrategy
BoostingStrategy
setUpdater
GradientDescent LBFGS
setUseNodeIdCache
Strategy
setUserBlocks
ALS
setUserCol
ALS ALSModel
setValidateData
GeneralizedLinearAlgorithm
setValidationTol
BoostingStrategy
setValue
Accumulable
setVarianceCol
DecisionTreeRegressionModel DecisionTreeRegressor
setVectorSize
Word2Vec Word2Vec
setVerbose
SparkLauncher
setVocabSize
CountVectorizer
setWeightCol
LogisticRegression NaiveBayes GeneralizedLinearRegression IsotonicRegression LinearRegression
setWindowSize
Word2Vec Word2Vec StreamingTest
setWithMean
StandardScaler StandardScalerModel
setWithStd
StandardScaler StandardScalerModel
setupCommitter
HadoopMapReduceCommitProtocol
setupJob
FileCommitProtocol HadoopMapReduceCommitProtocol
setupTask
FileCommitProtocol HadoopMapReduceCommitProtocol
sha1
functions
sha2
functions
shape
GammaGenerator
shiftLeft
functions
shiftRight
functions
shiftRightUnsigned
functions
short
ColumnName
shortName
OrcFileFormat DataSourceRegister
shouldOverwrite
MLWriter
show
Dataset
showMillisDistribution
StatsReportListener
shuffleHandle
ShuffleDependency
shuffleId
FetchFailed ShuffleDependency ShuffleBlockId ShuffleDataBlockId ShuffleIndexBlockId
shuffleManager
SparkEnv
shuffleRead
ExecutorStageSummary
shuffleReadBytes
StageData
shuffleReadMetrics
TaskMetricDistributions TaskMetrics
shuffleReadRecords
StageData
shuffleWrite
ExecutorStageSummary
shuffleWriteBytes
StageData
shuffleWriteMetrics
TaskMetricDistributions TaskMetrics
shuffleWriteRecords
StageData
sideEffectResult
InsertIntoHiveTable
sigma
MultivariateGaussian
signum
functions
simpleString
ArrayType ByteType DataType DecimalType IntegerType LongType MapType ObjectType ShortType StructType
sin
functions
sinh
functions
sink
StreamingQueryProgress
size
AttributeGroup DenseVector SparseVector Vector ParamMap DenseVector SparseVector Vector Row functions
sizeInBytes
BaseRelation
sketch
util
skewness
functions
skip
LZ4BlockInputStream NioBufferedFileInputStream
skippedStages
JobProgressListener
slice
JavaDStreamLike DStream
slideDuration
DStream InputDStream
sliding
RDDFunctions
socketStream
StreamingContext JavaStreamingContext
socketTextStream
StreamingContext JavaStreamingContext
solver
GeneralizedLinearRegressionTrainingSummary
sort
Dataset
sortBy
JavaRDD RDD DataFrameWriter
sortByKey
JavaPairRDD OrderedRDDFunctions
sortWithinPartitions
Dataset
sort_array
functions
soundex
functions
source
metrics ml
sourceName
CodegenMetrics HiveCatalogMetrics
sourceSchema
StreamSourceProvider
sourceToSerDe
HiveSerDe
sources
sql StreamingQueryProgress
spark
apache VersionInfo
sparkContext
RDD SQLContext SparkSession StreamingContext JavaStreamingContext
sparkProperties
EnvironmentListener
sparkSession
Dataset SQLContext StreamingQuery
sparkUser
SparkContext JavaSparkContext SparkListenerApplicationStart ApplicationAttemptInfo
spark_partition_id
functions
sparse
Matrices Vectors Matrices Vectors
sparsity
NumericAttribute
spdiag
SparseMatrix SparseMatrix
speculative
TaskInfo TaskData
speye
Matrices SparseMatrix Matrices SparseMatrix
split
InternalNode Node functions
splitIndex
RDDBlockId
splits
Bucketizer
sprand
Matrices SparseMatrix Matrices SparseMatrix
sprandn
Matrices SparseMatrix Matrices SparseMatrix
sqdist
Vectors Vectors
sql
spark SQLContext SparkSession ArrayType DataType DecimalType MapType StructType
sqlContext
Dataset SparkSession BaseRelation
sqlType
VectorUDT
sqrt
functions
srcAttr
EdgeContext EdgeTriplet
srcId
Edge EdgeContext
srdd
JavaDoubleRDD
ssc
JavaStreamingContext
stackTrace
ExceptionFailure
stageAttemptId
SparkListenerTaskEnd SparkListenerTaskStart
stageFailed
StageInfo
stageId
SparkStageInfo TaskContext SparkListenerTaskEnd SparkListenerTaskStart StageInfo StageData
stageIdToActiveJobIds
JobProgressListener
stageIdToData
JobProgressListener
stageIdToInfo
JobProgressListener
stageIds
SparkJobInfo SparkListenerJobStart JobData
stageInfo
SparkListenerStageCompleted SparkListenerStageSubmitted
stageInfos
SparkListenerJobStart
stages
Pipeline PipelineModel
stagingDir
InsertIntoHiveTable
starGraph
GraphGenerators
start
DataStreamWriter StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream
startApplication
SparkLauncher
startOffset
SourceProgress StreamingQueryException
startPosition
AnalysisException
startTime
SparkContext JavaSparkContext ApplicationAttemptInfo OutputOperationInfo JobProgressListener
startsWith
Column
stat
ml mllib Dataset
stateOperators
StreamingQueryProgress
stateSnapshots
JavaMapWithStateDStream MapWithStateDStream
statement
SQLTransformer
staticPageRank
GraphOps
staticParallelPersonalizedPageRank
GraphOps
staticPersonalizedPageRank
GraphOps
statistic
ChiSqTestResult KolmogorovSmirnovTestResult TestResult
stats
JavaDoubleRDD Node DoubleRDDFunctions
status
SparkJobInfo TaskInfo StreamingQuery spark JobData StageData
statusTracker
SparkContext JavaSparkContext
std
NumericAttribute StandardScalerModel StandardScalerModel LogNormalGenerator
stddev
functions
stddev_pop
functions
stddev_samp
functions
stdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
stop
SparkContext JavaSparkContext SparkAppHandle SparkSession StreamingQuery StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream Receiver
stopWords
StopWordsRemover
storage
spark ui
storageLevel
Dataset RDDPartitionInfo RDDStorageInfo BlockStatus BlockUpdatedInfo RDDInfo Receiver
storageStatusList
StorageStatusListener
store
Receiver
streamId
StreamBlockId Receiver ReceiverInfo
streamIdToInputInfo
BatchInfo
streaming
sql spark
streams
SQLContext SparkSession
string
ColumnName
stringWritableConverter
WritableConverter
stringWritableFactory
WritableFactory
stronglyConnectedComponents
GraphOps
struct
ColumnName functions
subgraph
Graph GraphImpl
submissionTime
SparkStageInfo StageInfo JobData StageData BatchInfo
submitJob
JobSubmitter SparkContext
subsamplingRate
Strategy
subsetAccuracy
MultilabelMetrics
substitute
VariableSubstitution
substr
Column
substring
functions
substring_index
functions
subtract
JavaDoubleRDD JavaPairRDD JavaRDD BlockMatrix RDD
subtractByKey
JavaPairRDD PairRDDFunctions
succeededTasks
ExecutorStageSummary
successful
TaskInfo
sum
JavaDoubleRDD DoubleRDDFunctions RelationalGroupedDataset typed functions DoubleAccumulator LongAccumulator StatCounter
sumApprox
JavaDoubleRDD DoubleRDDFunctions
sumDistinct
functions
sumLong
typed
summary
LogisticRegressionModel BisectingKMeansModel GaussianMixtureModel KMeansModel GeneralizedLinearRegressionModel LinearRegressionModel
supportedFeatureSubsetStrategies
RandomForestClassifier RandomForestRegressor RandomForest
supportedImpurities
DecisionTreeClassifier RandomForestClassifier DecisionTreeRegressor RandomForestRegressor
supportedLossTypes
GBTClassifier GBTRegressor
symbolToColumn
SQLImplicits
systemProperties
EnvironmentListener