co.cask.cdap.dq

Class DataQualityApp.FieldAggregator

java.lang.Object

co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

co.cask.cdap.internal.api.AbstractPluginConfigurable<MapReduceConfigurer>

co.cask.cdap.api.mapreduce.AbstractMapReduce

co.cask.cdap.dq.DataQualityApp.FieldAggregator

All Implemented Interfaces:

MapReduce

Enclosing class:

DataQualityApp

public static final class DataQualityApp.FieldAggregator
extends AbstractMapReduce

Map Reduce job that ingests a stream of data and builds an aggregation of the ingested data that maps timestamp, sourceId, field type and field value to frequency.

Constructor Summary

Constructors

Constructor and Description
DataQualityApp.FieldAggregator(DataQualitySource source, String datasetName, Map<String,Set<String>> fieldAggregations)

Method Summary

Methods

Modifier and Type	Method and Description
void	beforeSubmit(MapReduceContext context)
void	configure()

Methods inherited from class co.cask.cdap.api.mapreduce.AbstractMapReduce

configure, getConfigurer, onFinish, setDescription, setInputDataset, setMapperResources, setName, setOutputDataset, setProperties, setReducerResources, useDatasets, useDatasets, useStreamInput, useStreamInput, useStreamInput

Methods inherited from class co.cask.cdap.internal.api.AbstractPluginConfigurable

usePlugin, usePlugin, usePluginClass, usePluginClass

Methods inherited from class co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataQualityApp.FieldAggregator

public DataQualityApp.FieldAggregator(DataQualitySource source,
                              String datasetName,
                              Map<String,Set<String>> fieldAggregations)

Method Detail

configure

public void configure()

Overrides:

configure in class AbstractMapReduce

beforeSubmit

public void beforeSubmit(MapReduceContext context)
                  throws Exception

Specified by:

beforeSubmit in interface MapReduce

Overrides:

beforeSubmit in class AbstractMapReduce

Throws:

Exception