co.cask.cdap.etl.batch

Class KVTransformations

java.lang.Object

co.cask.cdap.etl.batch.KVTransformations

public final class KVTransformations
extends Object

Key-Value transformation which wraps transformation for each batch plugin to emit stageName along with each record except for BatchSink

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	KVTransformations.KVSinkTransformation<IN,OUT> Converts (stageName, input) to input
static class	KVTransformations.KVSourceTransformation<IN,OUT> Converts input to (stageName, input)
static class	KVTransformations.KVWrappedTransformation<IN,OUT> Unwraps (stageName, input) to input, applies transformation and wraps output to (stageName, output)

Method Summary

Methods

Modifier and Type	Method and Description
static Transformation	getKVTransformation(String stageName, String pluginType, boolean isMapPhase, Transformation transformation) Creates Transformation which adds stageName to each record being emitted from current stage, except for BatchSink.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getKVTransformation

public static Transformation getKVTransformation(String stageName,
                                 String pluginType,
                                 boolean isMapPhase,
                                 Transformation transformation)

Creates Transformation which adds stageName to each record being emitted from current stage, except for BatchSink. Each stage will strip off stageName, apply original transformation and then again wrap record with stageName. For Joiner the record is passed with stageName.

Parameters:

stageName - stageName which is emitting the record

pluginType - type of the stage

isMapPhase - if it is map phase

transformation - transformation to be wrapped

Returns:

Transformation to wrap/unwrap stageName