CANONICAL_NATIVE_VIEW

SQLConf

CASE_SENSITIVE

SQLConf

CHECKPOINT_LOCATION

SQLConf

COLUMN_BATCH_SIZE

SQLConf

COLUMN_NAME_OF_CORRUPT_RECORD

SQLConf

COMPRESS_CACHED

SQLConf

CalendarIntervalType

types

CanonicalRandomVertexCut

Catalog

CatalogImpl

CatalystScan

Categorical

CategoricalSplit

ChiSqSelector

ChiSqSelectorModel

ChiSqTestResult

Classification

ClassificationModel

classification classification

Classifier

classification

CoGroupFunction

function

CoGroupedRDD

rdd

Column

sql catalog

ColumnName

sql

ComplexFutureAction

spark

CompressionCodec

io

Conf

SVDPlusPlus

ConnectedComponents

lib

ConnectionFactory

JdbcRDD

ConstantInputDStream

dstream

Continuous

FeatureType

ContinuousQuery

sql

ContinuousQueryException

sql

ContinuousQueryListener

util

ContinuousQueryManager

sql

ContinuousSplit

CoordinateMatrix

CountMinSketch

CountVectorizer

CountVectorizerModel

CreatableRelationProvider

sources

CrossValidator

tuning

CrossValidatorModel

tuning

cache

JavaDoubleRDD JavaPairRDD JavaRDD Graph EdgeRDDImpl GraphImpl VertexRDDImpl BlockMatrix RDD Dataset JavaDStream JavaPairDStream DStream

cacheManager

SQLContext SparkSession

cacheSize

SparkExecutorInfo StorageStatus

cacheTable

SQLContext Catalog CatalogImpl

calculate

Entropy Gini Impurity Variance

call

callSite

RDDInfo

callUDF

functions

canEqual

ExecutorInfo MutablePair

canHandle

JdbcDialect

cancel

ComplexFutureAction FutureAction SimpleFutureAction

cancelAllJobs

SparkContext JavaSparkContext

cancelJobGroup

SparkContext JavaSparkContext

cartesian

caseSensitive

cast

catalog

catalogString

categoricalFeaturesInfo

Strategy

categories

Split

categoryMaps

VectorIndexerModel

cause

ContinuousQueryException

cbrt

ceil

changePrecision

checkErrors

checkpoint

JavaRDDLike Graph EdgeRDDImpl GraphImpl VertexRDDImpl HadoopRDD RDD StreamingContext JavaDStreamLike JavaStreamingContext DStream

checkpointFile

SparkContext JavaSparkContext

checkpointInterval

Strategy

chiSqTest

Statistics

child

InsertIntoHiveTable Not

className

ExceptionFailure Function

classTag

JavaDoubleRDD JavaPairRDD JavaRDD JavaRDDLike JavaDStream JavaDStreamLike JavaInputDStream JavaPairDStream JavaReceiverInputDStream

classification

ml mllib

classpathEntries

EnvironmentListener

clean

WriteAheadLog

clear

Params ExecutionListenerManager

clearActive

SQLContext

clearCache

SQLContext Catalog CatalogImpl

clearCallSite

SparkContext JavaSparkContext

clearDependencies

CoGroupedRDD RDD ShuffledRDD UnionRDD

clearJobGroup

SparkContext JavaSparkContext

clearThreshold

LogisticRegressionModel SVMModel

clone

SparkConf Decimal StorageLevel BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler

cloneComplement

BernoulliCellSampler

close

SparkOrcNewRecordReader JavaSparkContext DeserializationStream SerializationStream TimeTrackingOutputStream JavaStreamingContext WriteAheadLog

closureSerializer

SparkEnv

clsTag

Encoder

cluster

GaussianMixtureSummary KMeansSummary Assignment scheduler

clusterCenters

BisectingKMeansModel KMeansModel BisectingKMeansModel KMeansModel StreamingKMeansModel

clusterSizes

GaussianMixtureSummary KMeansSummary

clusterWeights

StreamingKMeansModel

clustering

ml mllib

coalesce

JavaDoubleRDD JavaPairRDD JavaRDD PartitionCoalescer RDD Dataset functions

coefficientStandardErrors

GeneralizedLinearRegressionTrainingSummary LinearRegressionSummary

coefficients

LogisticRegressionModel AFTSurvivalRegressionModel GeneralizedLinearRegressionModel LinearRegressionModel

cogroup

JavaPairRDD PairRDDFunctions KeyValueGroupedDataset JavaPairDStream PairDStreamFunctions

col

Dataset functions

colIter

DenseMatrix Matrix SparseMatrix DenseMatrix Matrix SparseMatrix

colPtrs

SparseMatrix SparseMatrix

colStats

Statistics

collect

JavaRDDLike EdgeRDDImpl RDD Dataset

collectAsList

Dataset

collectAsMap

JavaPairRDD PairRDDFunctions

collectAsync

JavaRDDLike AsyncRDDActions

collectEdges

collectNeighborIds

collectNeighbors

collectPartitions

collectToPython

collect_list

collect_set

colsPerBlock

column

columnSimilarities

IndexedRowMatrix RowMatrix

columns

Dataset

combineByKey

JavaPairRDD PairRDDFunctions JavaPairDStream PairDStreamFunctions

combineByKeyWithClassTag

PairRDDFunctions

combineCombinersByKey

Aggregator

combineValuesByKey

Aggregator

commitTask

SparkHadoopMapRedUtil

compare

Decimal RDDInfo

completed

ApplicationAttemptInfo

completedJobs

JobProgressListener

completedStages

JobProgressListener

completedTasks

ExecutorSummary

completionTime

StageInfo JobData StageData

compressed

Vector Vector

compressedInputStream

CompressionCodec LZ4CompressionCodec LZFCompressionCodec SnappyCompressionCodec

compressedOutputStream

CompressionCodec LZ4CompressionCodec LZFCompressionCodec SnappyCompressionCodec

compute

computeColumnSummaryStatistics

RowMatrix

computeCost

BisectingKMeansModel KMeansModel BisectingKMeansModel KMeansModel

computeCovariance

RowMatrix

computeError

Loss

computeGramianMatrix

IndexedRowMatrix RowMatrix

computeInitialPredictionAndError

GradientBoostedTreesModel

computePreferredLocations

InputFormatInfo

computePrincipalComponents

RowMatrix

computePrincipalComponentsAndExplainedVariance

RowMatrix

computeSVD

IndexedRowMatrix RowMatrix

concat

functions

concat_ws

functions

conf

SparkEnv SQLContext SparkSession

confidence

Rule BoundedDouble CountMinSketch

config

configuration

confusionMatrix

connect

connectLeader

connectedComponents

consequent

contains

SparkConf ParamMap Column RuntimeConfig Metadata

containsBlock

StorageStatus

containsNull

ArrayType

context

InterruptibleIterator JavaRDDLike MLReader MLWriter RDD JavaDStreamLike DStream

conv

functions

convertToCanonicalEdges

GraphOps

copy

Estimator Model Pipeline PipelineModel PipelineStage Predictor Transformer UnaryTransformer DecisionTreeClassificationModel DecisionTreeClassifier GBTClassificationModel GBTClassifier LogisticRegression LogisticRegressionModel MultilayerPerceptronClassificationModel MultilayerPerceptronClassifier NaiveBayes NaiveBayesModel OneVsRest OneVsRestModel RandomForestClassificationModel RandomForestClassifier BisectingKMeans BisectingKMeansModel DistributedLDAModel GaussianMixture GaussianMixtureModel KMeans KMeansModel LDA LocalLDAModel BinaryClassificationEvaluator Evaluator MulticlassClassificationEvaluator RegressionEvaluator Binarizer Bucketizer ChiSqSelector ChiSqSelectorModel CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString Interaction MaxAbsScaler MaxAbsScalerModel MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel PolynomialExpansion QuantileDiscretizer RFormula RFormulaModel RegexTokenizer SQLTransformer StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel Tokenizer VectorAssembler VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector ParamMap Params ALS ALSModel AFTSurvivalRegression AFTSurvivalRegressionModel DecisionTreeRegressionModel DecisionTreeRegressor GBTRegressionModel GBTRegressor GeneralizedLinearRegression GeneralizedLinearRegressionModel IsotonicRegression IsotonicRegressionModel LinearRegression LinearRegressionModel RandomForestRegressionModel RandomForestRegressor CrossValidator CrossValidatorModel TrainValidationSplit TrainValidationSplitModel DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator RandomDataGenerator StandardNormalGenerator UniformGenerator WeibullGenerator Strategy Row AccumulatorV2 DoubleAccumulator LegacyAccumulatorWrapper ListAccumulator LongAccumulator StatCounter

copyAndReset

AccumulatorV2 ListAccumulator

copyValues

Params

coresGranted

ApplicationInfo

coresPerExecutor

ApplicationInfo

corr

Statistics DataFrameStatFunctions functions

cos

functions

cosh

functions

count

JavaRDDLike EdgeRDDImpl VertexRDDImpl MultivariateOnlineSummarizer MultivariateStatisticalSummary RDD Dataset KeyValueGroupedDataset RelationalGroupedDataset typed functions JavaDStreamLike DStream OffsetRange DoubleAccumulator LongAccumulator StatCounter

countApprox

JavaRDDLike RDD

countApproxDistinct

JavaRDDLike RDD

countApproxDistinctByKey

JavaPairRDD PairRDDFunctions

countAsync

JavaRDDLike AsyncRDDActions

countByKey

JavaPairRDD PairRDDFunctions

countByKeyApprox

JavaPairRDD PairRDDFunctions

countByValue

JavaRDDLike RDD JavaDStreamLike DStream

countByValueAndWindow

JavaDStreamLike DStream

countByValueApprox

JavaRDDLike RDD

countByWindow

JavaDStreamLike DStream

countDistinct

functions

countMinSketch

DataFrameStatFunctions

countTowardsTaskFailures

ExecutorLostFailure TaskCommitDenied TaskFailedReason

cov

MultivariateGaussian DataFrameStatFunctions

covar_pop

functions

covar_samp

functions

crc32

functions

create

JdbcRDD PartitionPruningRDD ProcessingTime Broker OffsetRange RateEstimator

createCombiner

Aggregator

createDataFrame

SQLContext SparkSession

createDataset

SQLContext SparkSession

createDirectStream

KafkaUtils

createExternalTable

SQLContext Catalog CatalogImpl

createModel

LogisticRegressionWithLBFGS LogisticRegressionWithSGD SVMWithSGD GeneralizedLinearAlgorithm LassoWithSGD LinearRegressionWithSGD RidgeRegressionWithSGD

createOrReplaceTempView

Dataset

createPollingStream

FlumeUtils

createRDD

KafkaUtils

createRDDWithLocalProperties

DStream

createRelation

CreatableRelationProvider RelationProvider SchemaRelationProvider

createSink

StreamSinkProvider

createSource

StreamSourceProvider

createStream

FlumeUtils KafkaUtils KinesisUtils

createTempView

Dataset SparkSession

createTransformFunc

UnaryTransformer DCT ElementwiseProduct NGram Normalizer PolynomialExpansion RegexTokenizer Tokenizer

createUnsafe

Decimal

crosstab

DataFrameStatFunctions

csv

DataFrameReader DataFrameWriter

cube

cume_dist

currentAttemptId

currentDatabase

current_date

current_timestamp