C F G H I R S T

C

co.cask.hydrator.plugin.spark - package co.cask.hydrator.plugin.spark

co.cask.hydrator.plugin.spark.dynamic - package co.cask.hydrator.plugin.spark.dynamic

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.FileStreamingSource

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

configurePipeline(PipelineConfigurer) - Method in class co.cask.hydrator.plugin.spark.TwitterStreamingSource

createInterpreter() - Static method in class co.cask.hydrator.plugin.spark.dynamic.SparkCompilers

F

FileStreamingSource - Class in co.cask.hydrator.plugin.spark

Source that monitors a directory and reads files from it.

FileStreamingSource(FileStreamingSource.Conf) - Constructor for class co.cask.hydrator.plugin.spark.FileStreamingSource

FileStreamingSource.Conf - Class in co.cask.hydrator.plugin.spark

Configuration for the source.

FileStreamingSource.Conf() - Constructor for class co.cask.hydrator.plugin.spark.FileStreamingSource.Conf

G

getMainClass() - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkProgram.Config

getScalaCode() - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute.Config

getScalaCode() - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkProgram.Config

getSchema() - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute.Config

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.FileStreamingSource

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.HTTPPollerSource

getStream(StreamingContext) - Method in class co.cask.hydrator.plugin.spark.TwitterStreamingSource

H

HTTPPollerSource - Class in co.cask.hydrator.plugin.spark

Polls a http endpoints and outputs a record for each url response.

HTTPPollerSource(HTTPPollConfig) - Constructor for class co.cask.hydrator.plugin.spark.HTTPPollerSource

I

initialize(SparkExecutionPluginContext) - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute

R

ReferenceStreamingSource<T> - Class in co.cask.hydrator.plugin.spark

Base streaming source that adds an External Dataset for a reference name, and performs a single getDataset() call to make sure CDAP records that it was accessed.

ReferenceStreamingSource(ReferencePluginConfig) - Constructor for class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

run(JavaSparkExecutionContext) - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkProgram

S

ScalaSparkCompute - Class in co.cask.hydrator.plugin.spark.dynamic

A SparkCompute that takes any scala code and executes it.

ScalaSparkCompute(ScalaSparkCompute.Config) - Constructor for class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute

ScalaSparkCompute.Config - Class in co.cask.hydrator.plugin.spark.dynamic

Configuration object for the plugin

ScalaSparkCompute.Config(String, String) - Constructor for class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute.Config

ScalaSparkProgram - Class in co.cask.hydrator.plugin.spark.dynamic

A Spark program that executes user Spark code written in scala.

ScalaSparkProgram(ScalaSparkProgram.Config) - Constructor for class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkProgram

ScalaSparkProgram.Config - Class in co.cask.hydrator.plugin.spark.dynamic

Plugin configuration

ScalaSparkProgram.Config(String, String) - Constructor for class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkProgram.Config

SparkCompilers - Class in co.cask.hydrator.plugin.spark.dynamic

Helper class for Spark compilation.

T

transform(SparkExecutionPluginContext, JavaRDD<StructuredRecord>) - Method in class co.cask.hydrator.plugin.spark.dynamic.ScalaSparkCompute

TwitterStreamingSource - Class in co.cask.hydrator.plugin.spark

TwitterStreamingSource(TwitterStreamingSource.TwitterStreamingConfig) - Constructor for class co.cask.hydrator.plugin.spark.TwitterStreamingSource

TwitterStreamingSource.TwitterStreamingConfig - Class in co.cask.hydrator.plugin.spark

Config class for TwitterStreamingSource.

TwitterStreamingSource.TwitterStreamingConfig(String, String, String, String, String) - Constructor for class co.cask.hydrator.plugin.spark.TwitterStreamingSource.TwitterStreamingConfig

C F G H I R S T