SHUFFLE
BlockId
SHUFFLE_DATA
BlockId
SHUFFLE_INDEX
BlockId
SPARK_VERSION
spark
SPMap
ShortestPaths
SQLContext
sql
SQLSession
SQLContext HiveContext LocalSQLContext
SQLUserDefinedType
types
STREAM
BlockId
SVDPlusPlus
lib
SVMDataGenerator
util
SVMModel
classification
SVMWithSGD
classification
SaveMode
sql
Saveable
util
SchedulingMode
scheduler SchedulingMode
SchemaRDD
sql
SchemaRelationProvider
sources
Seconds
streaming
SequenceFileRDDFunctions
rdd
SerializableWritable
spark
SerializationStream
serializer
Serializer
serializer
SerializerInstance
serializer
ShortType
types
ShortestPaths
lib
ShuffleBlockId
storage
ShuffleDataBlockId
storage
ShuffleDependency
spark
ShuffleIndexBlockId
storage
ShuffleReadMetricDistributions
v1
ShuffleReadMetrics
v1
ShuffleWriteMetricDistributions
v1
ShuffleWriteMetrics
v1
ShuffledRDD
rdd
SimpleFutureAction
spark
SimpleUpdater
optimization
SingularValueDecomposition
linalg
SizeEstimator
util
SnappyCompressionCodec
io
Sort
QuantileStrategy
SparkConf
spark
SparkContext
spark
SparkEnv
spark
SparkException
spark
SparkFiles
spark
SparkFirehoseListener
spark
SparkFlumeEvent
flume
SparkHadoopMapRedUtil
mapred
SparkJobInfo
spark
SparkLauncher
launcher
SparkListener
scheduler
SparkListenerApplicationEnd
scheduler
SparkListenerApplicationStart
scheduler
SparkListenerBlockManagerAdded
scheduler
SparkListenerBlockManagerRemoved
scheduler
SparkListenerEnvironmentUpdate
scheduler
SparkListenerEvent
scheduler
SparkListenerExecutorAdded
scheduler
SparkListenerExecutorMetricsUpdate
scheduler
SparkListenerExecutorRemoved
scheduler
SparkListenerJobEnd
scheduler
SparkListenerJobStart
scheduler
SparkListenerStageCompleted
scheduler
SparkListenerStageSubmitted
scheduler
SparkListenerTaskEnd
scheduler
SparkListenerTaskGettingResult
scheduler
SparkListenerTaskStart
scheduler
SparkListenerUnpersistRDD
scheduler
SparkPlanner
SQLContext
SparkStageInfo
spark
SparkStatusTracker
spark
SparseMatrix
linalg
SparseVector
linalg
Split
tree model
SplitInfo
scheduler
SquaredError
loss
SquaredL2Updater
optimization
StageAttemptId
JobProgressListener
StageData
v1
StageId
JobProgressListener
StageInfo
scheduler
StageStatus
v1
StandardNormalGenerator
random
StandardScaler
feature feature
StandardScalerModel
feature feature
StatCounter
util
Statistics
stat receiver
StatsReportListener
scheduler scheduler
StorageLevel
storage
StorageLevels
java
StorageListener
storage
StorageStatus
storage
StorageStatusListener
storage
Strategy
configuration sql
StreamBlockId
storage
StreamingContext
streaming
StreamingContextState
streaming
StreamingKMeans
clustering
StreamingKMeansModel
clustering
StreamingLinearAlgorithm
regression
StreamingLinearRegressionWithSGD
regression
StreamingListener
scheduler
StreamingListenerBatchCompleted
scheduler
StreamingListenerBatchStarted
scheduler
StreamingListenerBatchSubmitted
scheduler
StreamingListenerEvent
scheduler
StreamingListenerReceiverError
scheduler
StreamingListenerReceiverStarted
scheduler
StreamingListenerReceiverStopped
scheduler
StreamingLogisticRegressionWithSGD
classification
StringArrayParam
param
StringContains
sources
StringEndsWith
sources
StringIndexer
feature
StringIndexerModel
feature
StringStartsWith
sources
StringToColumn
implicits
StringType
types
StronglyConnectedComponents
lib
StructField
types
StructType
types
Success
spark
s
SingularValueDecomposition
sample
JavaDoubleRDD JavaPairRDD JavaRDD RDD DataFrame BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler
sampleByKey
JavaPairRDD PairRDDFunctions
sampleByKeyExact
JavaPairRDD PairRDDFunctions
sampleStdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
sampleVariance
JavaDoubleRDD DoubleRDDFunctions StatCounter
save
LogisticRegressionModel NaiveBayesModel SVMModel GaussianMixtureModel KMeansModel PowerIterationClusteringModel Word2VecModel MatrixFactorizationModel IsotonicRegressionModel LassoModel LinearRegressionModel RidgeRegressionModel DecisionTreeModel GradientBoostedTreesModel RandomForestModel Saveable DataFrame DataFrameWriter
saveAsHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsHadoopFile
JavaPairRDD PairRDDFunctions
saveAsHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsLibSVMFile
MLUtils
saveAsNewAPIHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFile
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsObjectFile
JavaRDDLike RDD
saveAsObjectFiles
DStream
saveAsParquetFile
DataFrame
saveAsSequenceFile
SequenceFileRDDFunctions
saveAsTable
DataFrame DataFrameWriter
saveAsTextFile
JavaRDDLike RDD
saveAsTextFiles
DStream
saveLabeledData
MLUtils
sc
JavaSparkContext StringToColumn JavaStreamingContext
scalaIntToJavaLong
JavaDStreamLike
scalaToJavaLong
JavaPairDStream
scale
GammaGenerator Decimal DecimalType PrecisionInfo
scalingVec
ElementwiseProduct ElementwiseProduct
scheduler
spark streaming
schedulingDelay
BatchInfo
schedulingMode
JobProgressListener
schedulingPool
StageData
schema
DataFrame DataFrameReader Row BaseRelation HadoopFsRelation
scope
RDDInfo
scoreAndLabels
BinaryClassificationMetrics
seconds
Durations
securityManager
SparkEnv
select
DataFrame
selectExpr
DataFrame
selectedFeatures
ChiSqSelectorModel
sendToDst
EdgeContext
sendToSrc
EdgeContext
sequenceFile
SparkContext JavaSparkContext
serialize
SerializerInstance UserDefinedType
serializeStream
SerializerInstance
serializer
ShuffleDependency SparkEnv spark
sessionState
SQLSession
set
SparkConf SparkEnv EdgeTriplet Params Decimal UTF8String
setAggregator
ShuffledRDD
setAlgo
Strategy
setAll
SparkConf
setAlpha
ALS LDA ALS
setAppName
SparkConf SparkLauncher
setAppResource
SparkLauncher
setBandwidth
KernelDensity
setBeta
LDA
setBlocks
ALS
setCacheNodeIds
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor
setCallSite
SparkContext JavaSparkContext
setCategoricalFeaturesInfo
Strategy
setCheckpointDir
SparkContext JavaSparkContext
setCheckpointInterval
DecisionTreeClassifier GBTClassifier RandomForestClassifier ALS DecisionTreeRegressor GBTRegressor RandomForestRegressor LDA ALS Strategy
setClassifier
OneVsRest
setConf
SparkLauncher SQLContext HiveContext
setConvergenceTol
GaussianMixture LBFGS
setDecayFactor
StreamingKMeans
setDefault
Params
setDefaultClassLoader
Serializer
setDegree
PolynomialExpansion
setDeployMode
SparkLauncher
setDocConcentration
LDA
setDropLast
OneHotEncoder
setElasticNetParam
LogisticRegression LinearRegression
setEpsilon
KMeans
setEstimator
CrossValidator
setEstimatorParamMaps
CrossValidator
setEvaluator
CrossValidator
setExecutorEnv
SparkConf
setFeatureSubsetStrategy
RandomForestClassifier RandomForestRegressor
setFeaturesCol
PredictionModel Predictor
setFinalRDDStorageLevel
ALS
setFitIntercept
LogisticRegression
setGaps
RegexTokenizer
setGradient
GradientDescent LBFGS
setHalfLife
StreamingKMeans
setIfMissing
SparkConf
setImplicitPrefs
ALS ALS
setImpurity
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setInitialCenters
StreamingKMeans
setInitialModel
GaussianMixture
setInitialWeights
StreamingLogisticRegressionWithSGD StreamingLinearRegressionWithSGD
setInitializationMode
KMeans PowerIterationClustering
setInitializationSteps
KMeans
setInputCol
UnaryTransformer Binarizer Bucketizer HashingTF IDF IDFModel OneHotEncoder StandardScaler StandardScalerModel StringIndexer StringIndexerModel VectorIndexer VectorIndexerModel Word2Vec Word2VecModel
setInputCols
VectorAssembler
setIntercept
GeneralizedLinearAlgorithm
setIntermediateRDDStorageLevel
ALS
setIsotonic
IsotonicRegression
setItemCol
ALS ALSModel
setIterations
ALS
setJars
SparkConf
setJavaHome
SparkLauncher
setJobDescription
SparkContext
setJobGroup
SparkContext JavaSparkContext
setK
GaussianMixture KMeans LDA PowerIterationClustering StreamingKMeans
setKappa
OnlineLDAOptimizer
setKeyOrdering
ShuffledRDD
setLabelCol
Predictor BinaryClassificationEvaluator RegressionEvaluator
setLambda
NaiveBayes ALS
setLearningRate
Word2Vec BoostingStrategy
setLocalProperty
SparkContext JavaSparkContext
setLogLevel
SparkContext JavaSparkContext
setLoss
BoostingStrategy
setLossType
GBTClassifier GBTRegressor
setMainClass
SparkLauncher
setMapSideCombine
ShuffledRDD
setMaster
SparkConf SparkLauncher
setMaxBins
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxCategories
VectorIndexer
setMaxDepth
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxIter
GBTClassifier LogisticRegression Word2Vec ALS GBTRegressor LinearRegression
setMaxIterations
GaussianMixture KMeans LDA PowerIterationClustering
setMaxMemoryInMB
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxNumIterations
LBFGS
setMetricName
BinaryClassificationEvaluator RegressionEvaluator
setMinCount
Word2Vec Word2Vec
setMinInfoGain
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinInstancesPerNode
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinSupport
FPGrowth
setMinTokenLength
RegexTokenizer
setMiniBatchFraction
StreamingLogisticRegressionWithSGD OnlineLDAOptimizer GradientDescent StreamingLinearRegressionWithSGD
setModelType
NaiveBayes
setName
JavaDoubleRDD JavaPairRDD JavaRDD EdgeRDDImpl VertexRDDImpl RDD
setNonnegative
ALS ALS
setNumBlocks
ALS
setNumClasses
LogisticRegressionWithLBFGS Strategy
setNumCorrections
LBFGS
setNumFeatures
HashingTF
setNumFolds
CrossValidator
setNumItemBlocks
ALS
setNumIterations
StreamingLogisticRegressionWithSGD Word2Vec GradientDescent LBFGS StreamingLinearRegressionWithSGD BoostingStrategy
setNumPartitions
Word2Vec Word2Vec FPGrowth
setNumTrees
RandomForestClassifier RandomForestRegressor
setNumUserBlocks
ALS
setOptimizer
LDA
setOrNull
Decimal
setOutputCol
UnaryTransformer Binarizer Bucketizer HashingTF IDF IDFModel OneHotEncoder StandardScaler StandardScalerModel StringIndexer StringIndexerModel VectorAssembler VectorIndexer VectorIndexerModel Word2Vec Word2VecModel
setP
Normalizer
setParent
Model
setPattern
RegexTokenizer
setPredictionCol
PredictionModel Predictor RegressionEvaluator ALS ALSModel
setProductBlocks
ALS
setPropertiesFile
SparkLauncher
setQuantileCalculationStrategy
Strategy
setRandomCenters
StreamingKMeans
setRank
ALS ALS
setRatingCol
ALS
setRawPredictionCol
ClassificationModel Classifier
setRegParam
LogisticRegression ALS LinearRegression StreamingLogisticRegressionWithSGD GradientDescent LBFGS
setRuns
KMeans
setSample
KernelDensity
setScalingVec
ElementwiseProduct
setScoreCol
BinaryClassificationEvaluator
setSeed
GBTClassifier RandomForestClassifier Word2Vec ALS GBTRegressor RandomForestRegressor GaussianMixture KMeans LDA Word2Vec ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator StandardNormalGenerator UniformGenerator ALS BernoulliCellSampler BernoulliSampler PoissonSampler Pseudorandom
setSerializer
CoGroupedRDD ShuffledRDD
setSparkHome
SparkConf SparkLauncher
setSplits
Bucketizer
setStages
Pipeline
setStepSize
GBTClassifier Word2Vec GBTRegressor StreamingLogisticRegressionWithSGD GradientDescent StreamingLinearRegressionWithSGD
setSubsamplingRate
GBTClassifier RandomForestClassifier GBTRegressor RandomForestRegressor Strategy
setTaskContext
TaskContext
setTau0
OnlineLDAOptimizer
setThreshold
LogisticRegression LogisticRegressionModel Binarizer LogisticRegressionModel SVMModel
setTol
LogisticRegression LinearRegression
setTopicConcentration
LDA
setTreeStrategy
BoostingStrategy
setUpdater
GradientDescent LBFGS
setUseNodeIdCache
Strategy
setUserBlocks
ALS
setUserCol
ALS ALSModel
setValidateData
GeneralizedLinearAlgorithm
setValidationTol
BoostingStrategy
setValue
Accumulable
setVectorSize
Word2Vec Word2Vec
setVerbose
SparkLauncher
setWithMean
StandardScaler StandardScalerModel
setWithStd
StandardScaler StandardScalerModel
shape
GammaGenerator
short
ColumnName
show
DataFrame
showMillisDistribution
StatsReportListener
shuffleHandle
ShuffleDependency
shuffleId
FetchFailed ShuffleDependency ShuffleBlockId ShuffleDataBlockId ShuffleIndexBlockId
shuffleManager
SparkEnv
shuffleMemoryManager
SparkEnv
shuffleRead
ExecutorStageSummary
shuffleReadBytes
StageData
shuffleReadMetrics
TaskMetricDistributions TaskMetrics
shuffleReadRecords
StageData
shuffleWrite
ExecutorStageSummary
shuffleWriteBytes
StageData
shuffleWriteMetrics
TaskMetricDistributions TaskMetrics
shuffleWriteRecords
StageData
sigma
MultivariateGaussian
signum
functions
simpleString
QueryExecution QueryExecution ArrayType ByteType DataType DecimalType IntegerType LongType MapType ShortType StructType
sin
functions
sinh
functions
size
AttributeGroup ParamMap DenseVector SparseVector Vector Row
sizeInBytes
BaseRelation
skippedStages
JobProgressListener
slice
UTF8String JavaDStreamLike DStream
slideDuration
DStream InputDStream
sliding
RDDFunctions
socketStream
StreamingContext JavaStreamingContext
socketTextStream
StreamingContext JavaStreamingContext
sort
DataFrame
sortBy
JavaRDD RDD
sortByKey
JavaPairRDD OrderedRDDFunctions
sources
sql
spark
apache
sparkContext
RDD SQLContext SparkPlanner StreamingContext JavaStreamingContext
sparkFilesDir
SparkEnv
sparkPartitionId
functions
sparkPlan
QueryExecution
sparkProperties
EnvironmentListener
sparkUser
SparkContext JavaSparkContext SparkListenerApplicationStart ApplicationAttemptInfo
sparse
Matrices Vectors
sparsity
NumericAttribute
spdiag
SparseMatrix
speculative
TaskInfo TaskData
speye
Matrices SparseMatrix
split
InternalNode Node
splitIndex
RDDBlockId
splits
JavaRDDLike Bucketizer
sprand
Matrices SparseMatrix
sprandn
Matrices SparseMatrix
sqdist
Vectors
sql
spark SQLContext
sqlContext
DataFrame SparkPlanner BaseRelation
sqlParser
SQLContext
sqlType
UserDefinedType
sqrt
functions
squaredDist
Vector
srcAttr
EdgeContext EdgeTriplet
srcId
Edge EdgeContext
srdd
JavaDoubleRDD
ssc
JavaStreamingContext
stackTrace
ExceptionFailure
stageAttemptId
SparkListenerTaskEnd SparkListenerTaskStart
stageFailed
StageInfo
stageId
SparkStageInfo TaskContext SparkListenerTaskEnd SparkListenerTaskStart StageInfo StageData
stageIdToActiveJobIds
JobProgressListener
stageIdToData
JobProgressListener
stageIdToInfo
JobProgressListener
stageIds
SparkJobInfo SparkListenerJobStart JobData
stageInfo
SparkListenerStageCompleted SparkListenerStageSubmitted
stageInfos
SparkListenerJobStart
stageLogInfo
JobLogger
stages
Pipeline PipelineModel
starGraph
GraphGenerators
start
StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream
startPosition
AnalysisException
startTime
SparkContext JavaSparkContext ApplicationAttemptInfo JobProgressListener
startsWith
Column UTF8String
stat
mllib DataFrame
staticPageRank
GraphOps
staticPersonalizedPageRank
GraphOps
statistic
ChiSqTestResult TestResult
stats
JavaDoubleRDD Node DoubleRDDFunctions
status
SparkJobInfo TaskInfo spark JobData StageData
statusTracker
SparkContext JavaSparkContext
std
NumericAttribute StandardScalerModel LogNormalGenerator
stdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
stop
SparkContext JavaSparkContext BroadcastFactory HttpBroadcastFactory TorrentBroadcastFactory StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream Receiver
storage
spark ui
storageLevel
RDDPartitionInfo RDDStorageInfo BlockStatus RDDInfo Receiver
storageStatusList
StorageStatusListener ExecutorsListener StorageListener
store
ActorHelper Receiver
strategies
SparkPlanner
streamId
StreamBlockId Receiver ReceiverInfo
streamIdToNumRecords
BatchInfo
streaming
examples spark
string
ColumnName
stringOrError
QueryExecution
stringRddToDataFrameHolder
implicits
stringResult
QueryExecution
stringToText
SparkContext
stringWritableConverter
SparkContext WritableConverter
stringWritableFactory
WritableFactory
stronglyConnectedComponents
GraphOps
struct
ColumnName functions
subgraph
Graph GraphImpl
submissionTime
SparkStageInfo StageInfo JobData BatchInfo
submitJob
SparkContext
subsamplingRate
Strategy
subsetAccuracy
MultilabelMetrics
substitutor
HiveContext
substr
Column
subtract
JavaDoubleRDD JavaPairRDD JavaRDD RDD Vector
subtractByKey
JavaPairRDD PairRDDFunctions
succeededTasks
ExecutorStageSummary
successful
TaskInfo
sum
JavaDoubleRDD DoubleRDDFunctions GroupedData functions StatCounter Vector
sumApprox
JavaDoubleRDD DoubleRDDFunctions
sumDistinct
functions
supportedFeatureSubsetStrategies
RandomForestClassifier RandomForestRegressor RandomForest
supportedImpurities
DecisionTreeClassifier RandomForestClassifier DecisionTreeRegressor RandomForestRegressor
supportedLossTypes
GBTClassifier GBTRegressor
symbolToColumn
implicits
systemProperties
EnvironmentListener