co.cask.hydrator.plugin.spark

Class KafkaStreamingSource

java.lang.Object

co.cask.cdap.etl.api.streaming.StreamingSource<T>

co.cask.hydrator.plugin.spark.ReferenceStreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.plugin.spark.KafkaStreamingSource

All Implemented Interfaces:

co.cask.cdap.etl.api.PipelineConfigurable, Serializable

public class KafkaStreamingSource
extends ReferenceStreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

See Also:

Serialized Form

Field Summary

Fields inherited from class co.cask.cdap.etl.api.streaming.StreamingSource

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
KafkaStreamingSource(KafkaConfig conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord>	getStream(co.cask.cdap.etl.api.streaming.StreamingContext context)

Methods inherited from class co.cask.hydrator.plugin.spark.ReferenceStreamingSource

registerUsage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaStreamingSource

public KafkaStreamingSource(KafkaConfig conf)

Method Detail

configurePipeline

public void configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
                       throws IllegalArgumentException

Specified by:

configurePipeline in interface co.cask.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class ReferenceStreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Throws:

IllegalArgumentException

getStream

public org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord> getStream(co.cask.cdap.etl.api.streaming.StreamingContext context)
                                                                                                         throws Exception

Specified by:

getStream in class co.cask.cdap.etl.api.streaming.StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception