A B C D E F G H I J K L M N O P R S T W

A

asMap() - Method in class co.cask.cdap.etl.batch.customaction.BasicSettableArguments

B

BasicActionContext - Class in co.cask.cdap.etl.batch.customaction

Default implementation for the ActionContext.

BasicActionContext(CustomActionContext, Metrics, String) - Constructor for class co.cask.cdap.etl.batch.customaction.BasicActionContext

BasicSettableArguments - Class in co.cask.cdap.etl.batch.customaction

Default implementation of SettableArguments.

BasicSettableArguments(Map<String, String>) - Constructor for class co.cask.cdap.etl.batch.customaction.BasicSettableArguments

C

co.cask.cdap.etl.batch - package co.cask.cdap.etl.batch

co.cask.cdap.etl.batch.connector - package co.cask.cdap.etl.batch.connector

co.cask.cdap.etl.batch.conversion - package co.cask.cdap.etl.batch.conversion

co.cask.cdap.etl.batch.customaction - package co.cask.cdap.etl.batch.customaction

co.cask.cdap.etl.batch.join - package co.cask.cdap.etl.batch.join

co.cask.cdap.etl.batch.mapreduce - package co.cask.cdap.etl.batch.mapreduce

compareTo(TaggedWritable) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

compareTo(StructuredRecordWritable) - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

configure(WorkflowConfigurer) - Method in class co.cask.cdap.etl.batch.connector.ConnectorSource

configure() - Method in class co.cask.cdap.etl.batch.customaction.PipelineAction

configure() - Method in class co.cask.cdap.etl.batch.ETLBatchApplication

configure() - Method in class co.cask.cdap.etl.batch.ETLWorkflow

configure() - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce

ConnectorSink - Class in co.cask.cdap.etl.batch.connector

Internal batch sink used as a connector between pipeline phases.

ConnectorSink(String, String) - Constructor for class co.cask.cdap.etl.batch.connector.ConnectorSink

ConnectorSource - Class in co.cask.cdap.etl.batch.connector

Internal batch source used as a connector between pipeline phases.

ConnectorSource(String, Schema) - Constructor for class co.cask.cdap.etl.batch.connector.ConnectorSource

create(PipelinePhase) - Method in class co.cask.cdap.etl.batch.TransformExecutorFactory

Create a transform executor for the specified pipeline.

createRuntimeContext(String) - Method in class co.cask.cdap.etl.batch.mapreduce.MapReduceTransformExecutorFactory

createRuntimeContext(String) - Method in class co.cask.cdap.etl.batch.TransformExecutorFactory

D

DEFAULT_DESCRIPTION - Static variable in class co.cask.cdap.etl.batch.ETLBatchApplication

deleteSecureData(String, String) - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

DESCRIPTION - Static variable in class co.cask.cdap.etl.batch.ETLWorkflow

destroy() - Method in class co.cask.cdap.etl.batch.ETLWorkflow

destroy() - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce

destroy() - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLMapper

destroy() - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLReducer

destroy() - Method in class co.cask.cdap.etl.batch.mapreduce.TransformRunner

E

equals(Object) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

equals(Object) - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

ETLBatchApplication - Class in co.cask.cdap.etl.batch

ETL Batch Application.

ETLBatchApplication() - Constructor for class co.cask.cdap.etl.batch.ETLBatchApplication

ETLMapReduce - Class in co.cask.cdap.etl.batch.mapreduce

MapReduce Driver for ETL Batch Applications.

ETLMapReduce(BatchPhaseSpec) - Constructor for class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce

ETLMapReduce.ETLMapper - Class in co.cask.cdap.etl.batch.mapreduce

Mapper Driver for ETL Transforms.

ETLMapReduce.ETLMapper() - Constructor for class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLMapper

ETLMapReduce.ETLReducer - Class in co.cask.cdap.etl.batch.mapreduce

Reducer for a phase of an ETL pipeline.

ETLMapReduce.ETLReducer() - Constructor for class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLReducer

ETLWorkflow - Class in co.cask.cdap.etl.batch

Workflow for scheduling Batch ETL MapReduce Driver.

ETLWorkflow(BatchPipelineSpec, Engine) - Constructor for class co.cask.cdap.etl.batch.ETLWorkflow

execute(TxRunnable) - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

F

fromWritable(W) - Method in class co.cask.cdap.etl.batch.conversion.WritableConversion

G

get(String) - Method in class co.cask.cdap.etl.batch.customaction.BasicSettableArguments

get() - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

getArguments() - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

getConf() - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

getConversion(String) - Static method in class co.cask.cdap.etl.batch.conversion.WritableConversions

Get the conversion functions to and from the WritableComparable for the specified class.

getHadoopJob() - Method in class co.cask.cdap.etl.batch.WorkflowBackedActionContext

getInitializedTransformation(String) - Method in class co.cask.cdap.etl.batch.TransformExecutorFactory

Instantiates and initializes the plugin for the stage.

getKVTransformation(String, String, boolean, Transformation) - Static method in class co.cask.cdap.etl.batch.KVTransformations

Creates Transformation which adds stageName to each record being emitted from current stage, except for BatchSink.

getLogicalStartTime() - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

getNamespace() - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

getNodeStates() - Method in class co.cask.cdap.etl.batch.WorkflowBackedActionContext

getRecord() - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

getSecureData(String, String) - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

getStageName() - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

getToken() - Method in class co.cask.cdap.etl.batch.WorkflowBackedActionContext

getTrackedAggregateStep(Transformation<IN, OUT>, StageMetrics) - Static method in class co.cask.cdap.etl.batch.TransformExecutorFactory

getTrackedEmitKeyStep(Transformation<IN, OUT>, StageMetrics) - Static method in class co.cask.cdap.etl.batch.TransformExecutorFactory

getTrackedMergeStep(Transformation<IN, OUT>, StageMetrics) - Static method in class co.cask.cdap.etl.batch.TransformExecutorFactory

getTransformation(String, String) - Method in class co.cask.cdap.etl.batch.mapreduce.MapReduceTransformExecutorFactory

getTransformation(String, String) - Method in class co.cask.cdap.etl.batch.TransformExecutorFactory

getWritableClass() - Method in class co.cask.cdap.etl.batch.conversion.WritableConversion

H

has(String) - Method in class co.cask.cdap.etl.batch.customaction.BasicSettableArguments

hashCode() - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

hashCode() - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

I

initialize(WorkflowContext) - Method in class co.cask.cdap.etl.batch.ETLWorkflow

initialize(MapReduceTaskContext<Object, Object>) - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLMapper

initialize(MapReduceTaskContext<Object, Object>) - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLReducer

initialize() - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce

isMapPhase - Variable in class co.cask.cdap.etl.batch.TransformExecutorFactory

isSuccessful() - Method in class co.cask.cdap.etl.batch.WorkflowBackedActionContext

iterator() - Method in class co.cask.cdap.etl.batch.customaction.BasicSettableArguments

J

Join<JOIN_KEY,INPUT_RECORD,OUT> - Class in co.cask.cdap.etl.batch.join

Performs join operation

Join(Joiner<JOIN_KEY, INPUT_RECORD, OUT>, JOIN_KEY, Iterator<JoinElement<INPUT_RECORD>>, int, Emitter<OUT>) - Constructor for class co.cask.cdap.etl.batch.join.Join

joinRecords() - Method in class co.cask.cdap.etl.batch.join.Join

K

KVTransformations - Class in co.cask.cdap.etl.batch

Key-Value transformation which wraps transformation for each batch plugin to emit stageName along with each record except for BatchSink

KVTransformations.KVSinkTransformation<IN,OUT> - Class in co.cask.cdap.etl.batch

Converts (stageName, input) to input

KVTransformations.KVSinkTransformation(Transformation<IN, OUT>) - Constructor for class co.cask.cdap.etl.batch.KVTransformations.KVSinkTransformation

KVTransformations.KVSourceTransformation<IN,OUT> - Class in co.cask.cdap.etl.batch

Converts input to (stageName, input)

KVTransformations.KVSourceTransformation(String, Transformation<IN, OUT>) - Constructor for class co.cask.cdap.etl.batch.KVTransformations.KVSourceTransformation

KVTransformations.KVWrappedTransformation<IN,OUT> - Class in co.cask.cdap.etl.batch

Unwraps (stageName, input) to input, applies transformation and wraps output to (stageName, output)

KVTransformations.KVWrappedTransformation(String, Transformation<IN, OUT>) - Constructor for class co.cask.cdap.etl.batch.KVTransformations.KVWrappedTransformation

L

listSecureData(String) - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

M

map(Object, Object, Mapper.Context) - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLMapper

MapReduceTransformExecutorFactory<T> - Class in co.cask.cdap.etl.batch.mapreduce

Creates transform executors for mapreduce programs.

MapReduceTransformExecutorFactory(MapReduceTaskContext, PipelinePluginInstantiator, Metrics, Map<String, Map<String, String>>, String) - Constructor for class co.cask.cdap.etl.batch.mapreduce.MapReduceTransformExecutorFactory

metrics - Variable in class co.cask.cdap.etl.batch.TransformExecutorFactory

N

NAME - Static variable in class co.cask.cdap.etl.batch.ETLWorkflow

NAME - Static variable in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce

newPluginInstance(String, MacroEvaluator) - Method in class co.cask.cdap.etl.batch.PipelinePluginInstantiator

O

outputSchema - Variable in class co.cask.cdap.etl.batch.TransformExecutorFactory

P

perStageInputSchemas - Variable in class co.cask.cdap.etl.batch.TransformExecutorFactory

PipelineAction - Class in co.cask.cdap.etl.batch.customaction

Implementation of the CustomAction used in DataPipeline application.

PipelineAction(BatchPhaseSpec) - Constructor for class co.cask.cdap.etl.batch.customaction.PipelineAction

PipelinePluginInstantiator - Class in co.cask.cdap.etl.batch

Layer between the ETL programs and CDAP PluginContext to instantiate plugins for a stage in a pipeline.

PipelinePluginInstantiator(PluginContext, BatchPhaseSpec) - Constructor for class co.cask.cdap.etl.batch.PipelinePluginInstantiator

pluginInstantiator - Variable in class co.cask.cdap.etl.batch.TransformExecutorFactory

prepareRun(BatchSinkContext) - Method in class co.cask.cdap.etl.batch.connector.ConnectorSink

prepareRun(BatchSourceContext) - Method in class co.cask.cdap.etl.batch.connector.ConnectorSource

putSecureData(String, String, String, String, Map<String, String>) - Method in class co.cask.cdap.etl.batch.customaction.BasicActionContext

R

readFields(DataInput) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

readFields(DataInput) - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

reduce(Object, Iterable, Reducer.Context) - Method in class co.cask.cdap.etl.batch.mapreduce.ETLMapReduce.ETLReducer

run() - Method in class co.cask.cdap.etl.batch.customaction.PipelineAction

S

SCHEDULE_NAME - Static variable in class co.cask.cdap.etl.batch.ETLBatchApplication

set(String, String) - Method in class co.cask.cdap.etl.batch.customaction.BasicSettableArguments

set(StructuredRecord) - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

setConf(Configuration) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

setRecord(RECORD) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

setStageName(String) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

StructuredRecordWritable - Class in co.cask.cdap.etl.batch

Wrapper around a StructuredRecord so that it can be used as the output key and/or value of a mapper.

StructuredRecordWritable() - Constructor for class co.cask.cdap.etl.batch.StructuredRecordWritable

StructuredRecordWritable(StructuredRecord) - Constructor for class co.cask.cdap.etl.batch.StructuredRecordWritable

T

TaggedWritable<RECORD extends Writable> - Class in co.cask.cdap.etl.batch.mapreduce

Map output for which includes stageName and the record provided.

TaggedWritable() - Constructor for class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

TaggedWritable(String, RECORD) - Constructor for class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

toWritable(T) - Method in class co.cask.cdap.etl.batch.conversion.WritableConversion

transform(KeyValue<String, StructuredRecord>, Emitter<KeyValue<NullWritable, Text>>) - Method in class co.cask.cdap.etl.batch.connector.ConnectorSink

transform(KeyValue<LongWritable, Text>, Emitter<KeyValue<String, StructuredRecord>>) - Method in class co.cask.cdap.etl.batch.connector.ConnectorSource

transform(KeyValue<String, IN>, Emitter<OUT>) - Method in class co.cask.cdap.etl.batch.KVTransformations.KVSinkTransformation

transform(IN, Emitter<KeyValue<String, OUT>>) - Method in class co.cask.cdap.etl.batch.KVTransformations.KVSourceTransformation

transform(KeyValue<String, IN>, Emitter<KeyValue<String, OUT>>) - Method in class co.cask.cdap.etl.batch.KVTransformations.KVWrappedTransformation

transform(KEY, VALUE) - Method in class co.cask.cdap.etl.batch.mapreduce.TransformRunner

TransformExecutorFactory<T> - Class in co.cask.cdap.etl.batch

Helps create TransformExecutors.

TransformExecutorFactory(JobContext, PipelinePluginInstantiator, Metrics, String, MacroEvaluator) - Constructor for class co.cask.cdap.etl.batch.TransformExecutorFactory

TransformRunner<KEY,VALUE> - Class in co.cask.cdap.etl.batch.mapreduce

Initializes a TransformExecutor and runs transforms.

TransformRunner(MapReduceTaskContext<Object, Object>, Metrics) - Constructor for class co.cask.cdap.etl.batch.mapreduce.TransformRunner

W

WorkflowBackedActionContext - Class in co.cask.cdap.etl.batch

Implementation of BatchActionContext within a CDAP workflow.

WorkflowBackedActionContext(WorkflowContext, Metrics, LookupProvider, String, long, Map<String, String>) - Constructor for class co.cask.cdap.etl.batch.WorkflowBackedActionContext

WritableConversion<T,W extends Writable> - Class in co.cask.cdap.etl.batch.conversion

Functions to convert common classes to their Writable equivalent and vice versa.

WritableConversion() - Constructor for class co.cask.cdap.etl.batch.conversion.WritableConversion

WritableConversions - Class in co.cask.cdap.etl.batch.conversion

Functions to convert common classes to their WritableComparable equivalent and vice versa.

write(DataOutput) - Method in class co.cask.cdap.etl.batch.mapreduce.TaggedWritable

write(DataOutput) - Method in class co.cask.cdap.etl.batch.StructuredRecordWritable

A B C D E F G H I J K L M N O P R S T W