A C D F G H I K L N O P R S T V

A

asRecord(SparseVector) - Static method in class co.cask.hydrator.plugin.spark.VectorUtils

C

co.cask.hydrator.plugin.spark - package co.cask.hydrator.plugin.spark

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.FileStreamingSource

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.KafkaStreamingSource

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesClassifier

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesTrainer

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.NGramTransform

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.SkipGramTrainer

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.SparkMLPredictor

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.SparkMLTrainer

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.Tokenizer

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.TwitterStreamingSource

D

DecisionTreePredictor - Class in co.cask.hydrator.plugin.spark

SparkCompute that uses a trained model to tag input records using Decision Tree regression.

DecisionTreePredictor(SparkMLPredictor.MLPredictorConfig) - Constructor for class co.cask.hydrator.plugin.spark.DecisionTreePredictor

DecisionTreeTrainer - Class in co.cask.hydrator.plugin.spark

Spark Sink plugin that trains a model based upon a label in the structured record using Decision Tree Regression.

DecisionTreeTrainer(DecisionTreeTrainer.DecisionTreeTrainerConfig) - Constructor for class co.cask.hydrator.plugin.spark.DecisionTreeTrainer

DecisionTreeTrainer.DecisionTreeTrainerConfig - Class in co.cask.hydrator.plugin.spark

Configuration for DecisionTreeTrainer.

DecisionTreeTrainer.DecisionTreeTrainerConfig() - Constructor for class co.cask.hydrator.plugin.spark.DecisionTreeTrainer.DecisionTreeTrainerConfig

DecisionTreeTrainer.DecisionTreeTrainerConfig(String, String, String, String, String, String, Integer, Integer) - Constructor for class co.cask.hydrator.plugin.spark.DecisionTreeTrainer.DecisionTreeTrainerConfig

F

featureFieldsToExclude - Variable in class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

featureFieldsToExclude - Variable in class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

featureFieldsToInclude - Variable in class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

featureFieldsToInclude - Variable in class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

fileSetName - Variable in class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

fileSetName - Variable in class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

FileStreamingSource - Class in co.cask.hydrator.plugin.spark

Source that monitors a directory and reads files from it.

FileStreamingSource(FileStreamingSource.Conf) - Constructor for class co.cask.hydrator.plugin.spark.FileStreamingSource

FileStreamingSource.Conf - Class in co.cask.hydrator.plugin.spark

Configuration for the source.

FileStreamingSource.Conf() - Constructor for class co.cask.hydrator.plugin.spark.FileStreamingSource.Conf

fromRecord(StructuredRecord) - Static method in class co.cask.hydrator.plugin.spark.VectorUtils

G

getBrokerMap() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getBrokers() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getFormat() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getInitialPartitionOffsets(Set<Integer>) - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

Get the initial partition offsets for the specified partitions.

getKeyField() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getMessageSchema() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getOffsetField() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getOutputSchema(NaiveBayesClassifier.GetSchemaRequest) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesClassifier

getPartitionField() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getPartitions() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getSchema() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.FileStreamingSource

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.HTTPPollerSource

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.KafkaStreamingSource

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.TwitterStreamingSource

getTimeField() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

getTopic() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

H

HashingTFFeatureGenerator - Class in co.cask.hydrator.plugin.spark

Class to generate text based features using Hashing TF.

HashingTFFeatureGenerator(HashingTFFeatureGenerator.HashingTFConfig) - Constructor for class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator

HashingTFFeatureGenerator.HashingTFConfig - Class in co.cask.hydrator.plugin.spark

Configuration for the HashingTFFeatureGenerator.

HashingTFFeatureGenerator.HashingTFConfig() - Constructor for class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator.HashingTFConfig

HashingTFFeatureGenerator.HashingTFConfig(String, Integer, String) - Constructor for class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator.HashingTFConfig

HTTPPollerSource - Class in co.cask.hydrator.plugin.spark

Polls a http endpoints and outputs a record for each url response.

HTTPPollerSource(HTTPPollConfig) - Constructor for class co.cask.hydrator.plugin.spark.HTTPPollerSource

I

initialize(SparkContext, String) - Method in class co.cask.hydrator.plugin.spark.DecisionTreePredictor

initialize(SparkExecutionPluginContext) - Method in class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator

initialize(SparkContext, String) - Method in class co.cask.hydrator.plugin.spark.LogisticRegressionClassifier

initialize(SparkExecutionPluginContext) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesClassifier

initialize(SparkExecutionPluginContext) - Method in class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator

initialize(SparkExecutionPluginContext) - Method in class co.cask.hydrator.plugin.spark.SparkMLPredictor

initialize(SparkContext, String) - Method in class co.cask.hydrator.plugin.spark.SparkMLPredictor

initialize(SparkExecutionPluginContext) - Method in class co.cask.hydrator.plugin.spark.Tokenizer

K

KafkaConfig - Class in co.cask.hydrator.plugin.spark

Conf for Kafka streaming source.

KafkaConfig() - Constructor for class co.cask.hydrator.plugin.spark.KafkaConfig

KafkaConfig(String, String, String, String, String, String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.KafkaConfig

KafkaConfig(String, String, String, String, String, Long, String, String, String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.KafkaConfig

KafkaStreamingSource - Class in co.cask.hydrator.plugin.spark

KafkaStreamingSource(KafkaConfig) - Constructor for class co.cask.hydrator.plugin.spark.KafkaStreamingSource

L

labelField - Variable in class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

LogisticRegressionClassifier - Class in co.cask.hydrator.plugin.spark

SparkCompute that uses a trained Logistic Regression model to classify and tag input records.

LogisticRegressionClassifier(SparkMLPredictor.MLPredictorConfig) - Constructor for class co.cask.hydrator.plugin.spark.LogisticRegressionClassifier

LogisticRegressionTrainer - Class in co.cask.hydrator.plugin.spark

Spark Sink plugin that trains a model based upon various labels in the structured record.

LogisticRegressionTrainer(LogisticRegressionTrainer.Config) - Constructor for class co.cask.hydrator.plugin.spark.LogisticRegressionTrainer

LogisticRegressionTrainer.Config - Class in co.cask.hydrator.plugin.spark

Configuration for the LogisticRegressionTrainer.

LogisticRegressionTrainer.Config() - Constructor for class co.cask.hydrator.plugin.spark.LogisticRegressionTrainer.Config

LogisticRegressionTrainer.Config(String, String, String, String, String, Integer) - Constructor for class co.cask.hydrator.plugin.spark.LogisticRegressionTrainer.Config

N

NaiveBayesClassifier - Class in co.cask.hydrator.plugin.spark

SparkCompute that uses a trained model to classify and tag input records.

NaiveBayesClassifier() - Constructor for class co.cask.hydrator.plugin.spark.NaiveBayesClassifier

NaiveBayesClassifier.Config - Class in co.cask.hydrator.plugin.spark

Configuration for the NaiveBayesClassifier.

NaiveBayesClassifier.Config(String, String, String, String, Integer) - Constructor for class co.cask.hydrator.plugin.spark.NaiveBayesClassifier.Config

NaiveBayesTrainer - Class in co.cask.hydrator.plugin.spark

Spark Sink plugin that trains a model based upon a label in the structured record.

NaiveBayesTrainer() - Constructor for class co.cask.hydrator.plugin.spark.NaiveBayesTrainer

NaiveBayesTrainer.Config - Class in co.cask.hydrator.plugin.spark

Configuration for the NaiveBayesTrainer.

NaiveBayesTrainer.Config(String, String, String, String, Integer) - Constructor for class co.cask.hydrator.plugin.spark.NaiveBayesTrainer.Config

NGramTransform - Class in co.cask.hydrator.plugin.spark

NGramTransform - SparkCompute to transform input features into n-grams.

NGramTransform(NGramTransform.Config) - Constructor for class co.cask.hydrator.plugin.spark.NGramTransform

NGramTransform.Config - Class in co.cask.hydrator.plugin.spark

Configuration for the NGramTransform Plugin.

NGramTransform.Config(String, Integer, String) - Constructor for class co.cask.hydrator.plugin.spark.NGramTransform.Config

O

outputSchema - Variable in class co.cask.hydrator.plugin.spark.NGramTransform

P

path - Variable in class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

path - Variable in class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.DecisionTreePredictor

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.DecisionTreeTrainer

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.LogisticRegressionClassifier

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.LogisticRegressionTrainer

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.NaiveBayesClassifier

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.NaiveBayesTrainer

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.NGramTransform

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.SkipGramTrainer

PLUGIN_NAME - Static variable in class co.cask.hydrator.plugin.spark.Tokenizer

predict(Vector) - Method in class co.cask.hydrator.plugin.spark.DecisionTreePredictor

predict(Vector) - Method in class co.cask.hydrator.plugin.spark.LogisticRegressionClassifier

predict(Vector) - Method in class co.cask.hydrator.plugin.spark.SparkMLPredictor

predictionField - Variable in class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

prepareRun(SparkPluginContext) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesTrainer

prepareRun(SparkPluginContext) - Method in class co.cask.hydrator.plugin.spark.SkipGramTrainer

prepareRun(SparkPluginContext) - Method in class co.cask.hydrator.plugin.spark.SparkMLTrainer

R

ReferenceStreamingSource<T> - Class in co.cask.hydrator.plugin.spark

Base streaming source that adds an External Dataset for a reference name, and performs a single getDataset() call to make sure CDAP records that it was accessed.

ReferenceStreamingSource(ReferencePluginConfig) - Constructor for class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

registerUsage(Transactional) - Method in class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

run(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesTrainer

run(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.SkipGramTrainer

run(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.SparkMLTrainer

S

SkipGramFeatureGenerator - Class in co.cask.hydrator.plugin.spark

Class to generate text based features using SkipGram model (Spark's Word2Vec).

SkipGramFeatureGenerator(SkipGramFeatureGenerator.FeatureGeneratorConfig) - Constructor for class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator

SkipGramFeatureGenerator.FeatureGeneratorConfig - Class in co.cask.hydrator.plugin.spark

Config class for SkipGramFeatureGenerator.

SkipGramFeatureGenerator.FeatureGeneratorConfig() - Constructor for class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator.FeatureGeneratorConfig

SkipGramFeatureGenerator.FeatureGeneratorConfig(String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator.FeatureGeneratorConfig

SkipGramTrainer - Class in co.cask.hydrator.plugin.spark

Spark Sink plugin that trains a model using SkipGram (Spark's Word2Vec).

SkipGramTrainer() - Constructor for class co.cask.hydrator.plugin.spark.SkipGramTrainer

SkipGramTrainer.SkipGramTrainerConfig - Class in co.cask.hydrator.plugin.spark

Configuration for SkipGramTrainer.

SkipGramTrainer.SkipGramTrainerConfig() - Constructor for class co.cask.hydrator.plugin.spark.SkipGramTrainer.SkipGramTrainerConfig

SkipGramTrainer.SkipGramTrainerConfig(String, String, String, String, int, int, int, int, int) - Constructor for class co.cask.hydrator.plugin.spark.SkipGramTrainer.SkipGramTrainerConfig

SparkMLPredictor - Class in co.cask.hydrator.plugin.spark

Common class for Spark Predictors/Classifiers.

SparkMLPredictor(SparkMLPredictor.MLPredictorConfig) - Constructor for class co.cask.hydrator.plugin.spark.SparkMLPredictor

SparkMLPredictor.MLPredictorConfig - Class in co.cask.hydrator.plugin.spark

Config class for Predictors/Classifiers.

SparkMLPredictor.MLPredictorConfig(String, String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

SparkMLTrainer - Class in co.cask.hydrator.plugin.spark

Common class for Spark Trainers.

SparkMLTrainer(SparkMLTrainer.MLTrainerConfig) - Constructor for class co.cask.hydrator.plugin.spark.SparkMLTrainer

SparkMLTrainer.MLTrainerConfig - Class in co.cask.hydrator.plugin.spark

Config class for Trainers.

SparkMLTrainer.MLTrainerConfig() - Constructor for class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

SparkMLTrainer.MLTrainerConfig(String, String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

SPARSE_SCHEMA - Static variable in class co.cask.hydrator.plugin.spark.VectorUtils

T

Tokenizer - Class in co.cask.hydrator.plugin.spark

Tokenizer-SparkCompute that breaks text(such as sentence) into individual terms(usually words)

Tokenizer(Tokenizer.Config) - Constructor for class co.cask.hydrator.plugin.spark.Tokenizer

Tokenizer.Config - Class in co.cask.hydrator.plugin.spark

Configuration for the Tokenizer Plugin.

Tokenizer.Config(String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.Tokenizer.Config

trainModel(SparkContext, Schema, JavaRDD<LabeledPoint>, String) - Method in class co.cask.hydrator.plugin.spark.DecisionTreeTrainer

trainModel(SparkContext, Schema, JavaRDD<LabeledPoint>, String) - Method in class co.cask.hydrator.plugin.spark.LogisticRegressionTrainer

trainModel(SparkContext, Schema, JavaRDD<LabeledPoint>, String) - Method in class co.cask.hydrator.plugin.spark.SparkMLTrainer

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.HashingTFFeatureGenerator

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.NaiveBayesClassifier

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.NGramTransform

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.SkipGramFeatureGenerator

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.SparkMLPredictor

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.Tokenizer

TwitterStreamingSource - Class in co.cask.hydrator.plugin.spark

TwitterStreamingSource(TwitterStreamingSource.TwitterStreamingConfig) - Constructor for class co.cask.hydrator.plugin.spark.TwitterStreamingSource

TwitterStreamingSource.TwitterStreamingConfig - Class in co.cask.hydrator.plugin.spark

Config class for TwitterStreamingSource.

TwitterStreamingSource.TwitterStreamingConfig(String, String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.TwitterStreamingSource.TwitterStreamingConfig

V

validate() - Method in class co.cask.hydrator.plugin.spark.KafkaConfig

validate(Schema) - Method in class co.cask.hydrator.plugin.spark.SkipGramTrainer.SkipGramTrainerConfig

validate(Schema) - Method in class co.cask.hydrator.plugin.spark.SparkMLPredictor.MLPredictorConfig

validate(Schema) - Method in class co.cask.hydrator.plugin.spark.SparkMLTrainer.MLTrainerConfig

VectorUtils - Class in co.cask.hydrator.plugin.spark

Vector utility class to handle sparse vectors.

VectorUtils() - Constructor for class co.cask.hydrator.plugin.spark.VectorUtils

A C D F G H I K L N O P R S T V