co.cask.cdap.etl.api.streaming

Class StreamingSource<T>

java.lang.Object

co.cask.cdap.etl.api.streaming.StreamingSource<T>

Type Parameters:

T - type of object contained in the stream

All Implemented Interfaces:

PipelineConfigurable, Serializable

@Beta
public abstract class StreamingSource<T>
extends Object
implements PipelineConfigurable, Serializable

Source for Spark Streaming pipelines.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
StreamingSource()

Method Summary

Methods

Modifier and Type	Method and Description
void	configurePipeline(PipelineConfigurer pipelineConfigurer)
abstract org.apache.spark.streaming.api.java.JavaDStream<T>	getStream(StreamingContext context) Get the stream to read from.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_TYPE

public static final String PLUGIN_TYPE

See Also:

Constant Field Values

Constructor Detail

StreamingSource

public StreamingSource()

Method Detail

getStream

public abstract org.apache.spark.streaming.api.java.JavaDStream<T> getStream(StreamingContext context)
                                                                      throws Exception

Get the stream to read from.

Parameters:

context - the streaming context for this stage of the pipeline

Returns:

the stream to read from.

Throws:

Exception

configurePipeline

public void configurePipeline(PipelineConfigurer pipelineConfigurer)
                       throws IllegalArgumentException

Specified by:

configurePipeline in interface PipelineConfigurable

Throws:

IllegalArgumentException