co.cask.hydrator.plugin.spark

Class LogisticRegressionTrainer

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.SparkPluginContext>

co.cask.cdap.etl.api.batch.SparkSink<co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.plugin.spark.SparkMLTrainer

co.cask.hydrator.plugin.spark.LogisticRegressionTrainer

All Implemented Interfaces:

co.cask.cdap.etl.api.PipelineConfigurable, Serializable

public class LogisticRegressionTrainer
extends SparkMLTrainer

Spark Sink plugin that trains a model based upon various labels in the structured record. Writes this model to a file of a FileSet.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LogisticRegressionTrainer.Config Configuration for the LogisticRegressionTrainer.

Nested classes/interfaces inherited from class co.cask.hydrator.plugin.spark.SparkMLTrainer

SparkMLTrainer.MLTrainerConfig

Field Summary

Fields

Modifier and Type	Field and Description
static String	PLUGIN_NAME

Fields inherited from class co.cask.cdap.etl.api.batch.SparkSink

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
LogisticRegressionTrainer(LogisticRegressionTrainer.Config config)

Method Summary

Methods

Modifier and Type	Method and Description
void	trainModel(org.apache.spark.SparkContext context, co.cask.cdap.api.data.schema.Schema inputschema, org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> trainingData, String modelPath)

Methods inherited from class co.cask.hydrator.plugin.spark.SparkMLTrainer

configurePipeline, prepareRun, run

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_NAME

public static final String PLUGIN_NAME

See Also:

Constant Field Values

Constructor Detail

LogisticRegressionTrainer

public LogisticRegressionTrainer(LogisticRegressionTrainer.Config config)

Method Detail

trainModel

public void trainModel(org.apache.spark.SparkContext context,
              co.cask.cdap.api.data.schema.Schema inputschema,
              org.apache.spark.api.java.JavaRDD<org.apache.spark.mllib.regression.LabeledPoint> trainingData,
              String modelPath)

Specified by:

trainModel in class SparkMLTrainer