co.cask.cdap.dq

Class DataQualityApp.FieldAggregator

java.lang.Object

co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

co.cask.cdap.internal.api.AbstractPluginConfigurable<MapReduceConfigurer>

co.cask.cdap.api.mapreduce.AbstractMapReduce

co.cask.cdap.dq.DataQualityApp.FieldAggregator

All Implemented Interfaces:

MapReduce, ProgramLifecycle<MapReduceContext>

Enclosing class:

DataQualityApp

public static final class DataQualityApp.FieldAggregator
extends AbstractMapReduce

Map Reduce job that ingests a stream of data and builds an aggregation of the ingested data that maps timestamp, sourceId, field type and field value to frequency.

Constructor Summary

Constructors

Constructor and Description
DataQualityApp.FieldAggregator(DataQualitySource source, String datasetName, Map<String,Set<String>> fieldAggregations)

Method Summary

Methods

Modifier and Type	Method and Description
void	configure()
void	initialize()

Methods inherited from class co.cask.cdap.api.mapreduce.AbstractMapReduce

beforeSubmit, configure, destroy, getConfigurer, getContext, initialize, onFinish, setDescription, setDriverResources, setMapperResources, setName, setProperties, setReducerResources

Methods inherited from class co.cask.cdap.internal.api.AbstractPluginConfigurable

usePlugin, usePlugin, usePluginClass, usePluginClass

Methods inherited from class co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataQualityApp.FieldAggregator

public DataQualityApp.FieldAggregator(DataQualitySource source,
                              String datasetName,
                              Map<String,Set<String>> fieldAggregations)

Method Detail

configure

public void configure()

Overrides:

configure in class AbstractMapReduce

initialize

public void initialize()
                throws Exception

Overrides:

initialize in class AbstractMapReduce

Throws:

Exception