Package co.cask.hydrator.plugin.spark

Class Summary

Class	Description
DecisionTreePredictor	SparkCompute that uses a trained model to tag input records using Decision Tree regression.
DecisionTreeTrainer	Spark Sink plugin that trains a model based upon a label in the structured record using Decision Tree Regression.
DecisionTreeTrainer.DecisionTreeTrainerConfig	Configuration for DecisionTreeTrainer.
FileStreamingSource	Source that monitors a directory and reads files from it.
FileStreamingSource.Conf	Configuration for the source.
HashingTFFeatureGenerator	Class to generate text based features using Hashing TF.
HashingTFFeatureGenerator.HashingTFConfig	Configuration for the HashingTFFeatureGenerator.
HTTPPollerSource	Polls a http endpoints and outputs a record for each url response.
KafkaConfig	Conf for Kafka streaming source.
KafkaStreamingSource
LogisticRegressionClassifier	SparkCompute that uses a trained Logistic Regression model to classify and tag input records.
LogisticRegressionTrainer	Spark Sink plugin that trains a model based upon various labels in the structured record.
LogisticRegressionTrainer.Config	Configuration for the LogisticRegressionTrainer.
NaiveBayesClassifier	SparkCompute that uses a trained model to classify and tag input records.
NaiveBayesClassifier.Config	Configuration for the NaiveBayesClassifier.
NaiveBayesTrainer	Spark Sink plugin that trains a model based upon a label in the structured record.
NaiveBayesTrainer.Config	Configuration for the NaiveBayesTrainer.
NGramTransform	NGramTransform - SparkCompute to transform input features into n-grams.
NGramTransform.Config	Configuration for the NGramTransform Plugin.
ReferenceStreamingSource<T>	Base streaming source that adds an External Dataset for a reference name, and performs a single getDataset() call to make sure CDAP records that it was accessed.
SkipGramFeatureGenerator	Class to generate text based features using SkipGram model (Spark's Word2Vec).
SkipGramFeatureGenerator.FeatureGeneratorConfig	Config class for SkipGramFeatureGenerator.
SkipGramTrainer	Spark Sink plugin that trains a model using SkipGram (Spark's Word2Vec).
SkipGramTrainer.SkipGramTrainerConfig	Configuration for SkipGramTrainer.
SparkMLPredictor	Common class for Spark Predictors/Classifiers.
SparkMLPredictor.MLPredictorConfig	Config class for Predictors/Classifiers.
SparkMLTrainer	Common class for Spark Trainers.
SparkMLTrainer.MLTrainerConfig	Config class for Trainers.
Tokenizer	Tokenizer-SparkCompute that breaks text(such as sentence) into individual terms(usually words)
Tokenizer.Config	Configuration for the Tokenizer Plugin.
TwitterStreamingSource
TwitterStreamingSource.TwitterStreamingConfig	Config class for TwitterStreamingSource.
VectorUtils	Vector utility class to handle sparse vectors.