co.cask.hydrator.plugin

Class HDFSSink

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.BatchSinkContext>

co.cask.cdap.etl.api.batch.BatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

co.cask.hydrator.plugin.HDFSSink

All Implemented Interfaces:

co.cask.cdap.etl.api.Destroyable, co.cask.cdap.etl.api.PipelineConfigurable, co.cask.cdap.etl.api.StageLifecycle<co.cask.cdap.etl.api.batch.BatchRuntimeContext>, co.cask.cdap.etl.api.Transformation<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>>

public class HDFSSink
extends co.cask.cdap.etl.api.batch.BatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

HDFS Sink

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HDFSSink.HDFSSinkConfig Config for HDFSSinkConfig.
static class	HDFSSink.SinkOutputFormatProvider HDFS Sink Output Provider.

Constructor Summary

Constructors

Constructor and Description
HDFSSink(HDFSSink.HDFSSinkConfig config)

Method Summary

Methods

Modifier and Type	Method and Description
void	configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
void	prepareRun(co.cask.cdap.etl.api.batch.BatchSinkContext context)
void	transform(co.cask.cdap.api.data.format.StructuredRecord input, co.cask.cdap.etl.api.Emitter<co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>> emitter)

Methods inherited from class co.cask.cdap.etl.api.batch.BatchSink

destroy, initialize

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HDFSSink

public HDFSSink(HDFSSink.HDFSSinkConfig config)

Method Detail

configurePipeline

public void configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface co.cask.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.BatchSinkContext>

prepareRun

public void prepareRun(co.cask.cdap.etl.api.batch.BatchSinkContext context)
                throws Exception

Specified by:

prepareRun in class co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.BatchSinkContext>

Throws:

Exception

transform

public void transform(co.cask.cdap.api.data.format.StructuredRecord input,
             co.cask.cdap.etl.api.Emitter<co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>> emitter)
               throws Exception

Specified by:

transform in interface co.cask.cdap.etl.api.Transformation<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>>

Overrides:

transform in class co.cask.cdap.etl.api.batch.BatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

Throws:

Exception