co.cask.hydrator.plugin.spark

Class HTTPPollerSource

java.lang.Object

co.cask.cdap.etl.api.streaming.StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.plugin.spark.HTTPPollerSource

All Implemented Interfaces:

co.cask.cdap.etl.api.PipelineConfigurable, Serializable

public class HTTPPollerSource
extends co.cask.cdap.etl.api.streaming.StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Polls a http endpoints and outputs a record for each url response.

See Also:

Serialized Form

Field Summary

Fields inherited from class co.cask.cdap.etl.api.streaming.StreamingSource

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
HTTPPollerSource(HTTPPollConfig conf)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord>	getStream(co.cask.cdap.etl.api.streaming.StreamingContext streamingContext)

Methods inherited from class co.cask.cdap.etl.api.streaming.StreamingSource

configurePipeline

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HTTPPollerSource

public HTTPPollerSource(HTTPPollConfig conf)

Method Detail

getStream

public org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord> getStream(co.cask.cdap.etl.api.streaming.StreamingContext streamingContext)
                                                                                                         throws Exception

Specified by:

getStream in class co.cask.cdap.etl.api.streaming.StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception