co.cask.hydrator.plugin.spark

Class TwitterStreamingSource

java.lang.Object

co.cask.cdap.etl.api.streaming.StreamingSource<T>

co.cask.hydrator.plugin.spark.ReferenceStreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.plugin.spark.TwitterStreamingSource

All Implemented Interfaces:

co.cask.cdap.etl.api.PipelineConfigurable, Serializable

public class TwitterStreamingSource
extends ReferenceStreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TwitterStreamingSource.TwitterStreamingConfig Config class for TwitterStreamingSource.

Field Summary

Fields inherited from class co.cask.cdap.etl.api.streaming.StreamingSource

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
TwitterStreamingSource(TwitterStreamingSource.TwitterStreamingConfig config)

Method Summary

Methods

Modifier and Type	Method and Description
void	configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord>	getStream(co.cask.cdap.etl.api.streaming.StreamingContext context)

Methods inherited from class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

registerUsage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TwitterStreamingSource

public TwitterStreamingSource(TwitterStreamingSource.TwitterStreamingConfig config)

Method Detail

configurePipeline

public void configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface co.cask.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class ReferenceStreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

getStream

public org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord> getStream(co.cask.cdap.etl.api.streaming.StreamingContext context)
                                                                                                         throws Exception

Specified by:

getStream in class co.cask.cdap.etl.api.streaming.StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception