co.cask.hydrator.plugin

Class HDFSSink

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<BatchSinkContext>

co.cask.cdap.etl.api.batch.BatchSink<IN,KEY_OUT,VAL_OUT>

co.cask.hydrator.common.ReferenceBatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

co.cask.hydrator.plugin.HDFSSink

All Implemented Interfaces:

Destroyable, PipelineConfigurable, StageLifecycle<BatchRuntimeContext>, SubmitterLifecycle<BatchSinkContext>, Transformation<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>>

public class HDFSSink
extends ReferenceBatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

HDFS Sink

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HDFSSink.HDFSSinkConfig Config for HDFS Sink.
static class	HDFSSink.SinkOutputFormatProvider HDFS Sink Output Provider.

Field Summary

Fields

Modifier and Type	Field and Description
static String	NULL_STRING

Fields inherited from class co.cask.cdap.etl.api.batch.BatchSink

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
HDFSSink(HDFSSink.HDFSSinkConfig config)

Method Summary

Modifier and Type	Method and Description
void	configurePipeline(PipelineConfigurer pipelineConfigurer)
void	prepareRun(BatchSinkContext context)
void	transform(co.cask.cdap.api.data.format.StructuredRecord input, Emitter<co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>> emitter)

Methods inherited from class co.cask.cdap.etl.api.batch.BatchSink

destroy, initialize

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NULL_STRING

public static final String NULL_STRING

See Also:

Constant Field Values

Constructor Detail

HDFSSink

public HDFSSink(HDFSSink.HDFSSinkConfig config)

Method Detail

configurePipeline

public void configurePipeline(PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface PipelineConfigurable

Overrides:

configurePipeline in class ReferenceBatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

prepareRun

public void prepareRun(BatchSinkContext context)
                throws Exception

Specified by:

prepareRun in interface SubmitterLifecycle<BatchSinkContext>

Specified by:

prepareRun in class BatchConfigurable<BatchSinkContext>

Throws:

Exception

transform

public void transform(co.cask.cdap.api.data.format.StructuredRecord input,
                      Emitter<co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>> emitter)
               throws Exception

Specified by:

transform in interface Transformation<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.dataset.lib.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>>

Overrides:

transform in class BatchSink<co.cask.cdap.api.data.format.StructuredRecord,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

Throws:

Exception