A B C D E F G H I M R S T U V

A

add(DataQualityWritable) - Method in interface co.cask.cdap.dq.functions.BasicAggregationFunction

Incrementally add values to the aggregation

add(DataQualityWritable) - Method in class co.cask.cdap.dq.functions.DiscreteValuesHistogram

add(DataQualityWritable) - Method in class co.cask.cdap.dq.functions.HistogramWithBucketing

add(DataQualityWritable) - Method in class co.cask.cdap.dq.functions.Mean

add(DataQualityWritable) - Method in class co.cask.cdap.dq.functions.StandardDeviation

add(DataQualityWritable) - Method in class co.cask.cdap.dq.functions.UniqueValues

addAggregations(Set<AggregationTypeValue>) - Method in class co.cask.cdap.dq.FieldDetail

aggregate() - Method in interface co.cask.cdap.dq.functions.BasicAggregationFunction

Return the aggregation accumulated using add() in the form of a byte[]

aggregate() - Method in class co.cask.cdap.dq.functions.DiscreteValuesHistogram

aggregate() - Method in class co.cask.cdap.dq.functions.HistogramWithBucketing

aggregate() - Method in class co.cask.cdap.dq.functions.Mean

aggregate() - Method in class co.cask.cdap.dq.functions.StandardDeviation

aggregate() - Method in class co.cask.cdap.dq.functions.UniqueValues

AggregationsRowKey - Class in co.cask.cdap.dq.rowkey

Class for constructing tableRowKeys that consist of the byte[] representation of "Aggregations" concatenated with sourceID and then timestamp.

AggregationsRowKey(long, String) - Constructor for class co.cask.cdap.dq.rowkey.AggregationsRowKey

aggregationTypesGetter(HttpServiceRequest, HttpServiceResponder, String, String, long, long) - Method in class co.cask.cdap.dq.DataQualityService.ValuesLookup

Gets the aggregation functions that are queryable for a given time range, sourceID, and field name

AggregationTypeValue - Class in co.cask.cdap.dq

Class for the object that will represent a given aggregation type.

AggregationTypeValue(String, boolean) - Constructor for class co.cask.cdap.dq.AggregationTypeValue

B

BasicAggregationFunction<T> - Interface in co.cask.cdap.dq.functions

Basic Aggregation Function Interface: All aggregation function classes -- combinable or non-combinable -- should implement these methods

basicAggregationGetter(HttpServiceRequest, HttpServiceResponder, String, String, String, long, long) - Method in class co.cask.cdap.dq.DataQualityService.ValuesLookup

Gets the corresponding aggregation for a given aggregation type, field name, sourceID, and time interval

C

co.cask.cdap.dq - package co.cask.cdap.dq

Package for Data Quality Application

co.cask.cdap.dq.functions - package co.cask.cdap.dq.functions

co.cask.cdap.dq.rowkey - package co.cask.cdap.dq.rowkey

CombinableAggregationFunction<T> - Interface in co.cask.cdap.dq.functions

Aggregation Function Interface This is for aggregation that still make sense when combined.

combinableAggregationGetter(HttpServiceRequest, HttpServiceResponder, String, String, String, long, long) - Method in class co.cask.cdap.dq.DataQualityService.ValuesLookup

Gets the corresponding aggregation for a given aggregation type, field name, sourceID, and time interval

combine(byte[]) - Method in interface co.cask.cdap.dq.functions.CombinableAggregationFunction

Combine existing aggregations one-by-one

combine(byte[]) - Method in class co.cask.cdap.dq.functions.DiscreteValuesHistogram

combine(byte[]) - Method in class co.cask.cdap.dq.functions.UniqueValues

configure() - Method in class co.cask.cdap.dq.DataQualityApp

configure() - Method in class co.cask.cdap.dq.DataQualityApp.FieldAggregator

configure() - Method in class co.cask.cdap.dq.DataQualityService

configure() - Method in class co.cask.cdap.dq.DataQualityWorkflow

D

DataQualityApp - Class in co.cask.cdap.dq

Data Quality Application

DataQualityApp() - Constructor for class co.cask.cdap.dq.DataQualityApp

DataQualityApp.AggregationMapper - Class in co.cask.cdap.dq

Take in data and output a field type as a key and a DataQualityWritable containing the field value as an associated value.

DataQualityApp.AggregationMapper() - Constructor for class co.cask.cdap.dq.DataQualityApp.AggregationMapper

DataQualityApp.AggregationReducer - Class in co.cask.cdap.dq

Generate and write an aggregation with the data collected by the mapper

DataQualityApp.AggregationReducer() - Constructor for class co.cask.cdap.dq.DataQualityApp.AggregationReducer

DataQualityApp.DataQualityConfig - Class in co.cask.cdap.dq

Configuration Class for the application Sets following fields: aggregationName, fields (a comma separated list of the fields we want to aggregate over), workflowScheduleMinutes, source, datasetName, inputFormat, and schema.

DataQualityApp.DataQualityConfig(int, DataQualitySource, String, Map<String, Set<String>>) - Constructor for class co.cask.cdap.dq.DataQualityApp.DataQualityConfig

DataQualityApp.FieldAggregator - Class in co.cask.cdap.dq

Map Reduce job that ingests a stream of data and builds an aggregation of the ingested data that maps timestamp, sourceId, field type and field value to frequency.

DataQualityApp.FieldAggregator(DataQualitySource, String, Map<String, Set<String>>) - Constructor for class co.cask.cdap.dq.DataQualityApp.FieldAggregator

DataQualityService - Class in co.cask.cdap.dq

Service for querying values in the data quality histogram

DataQualityService(String) - Constructor for class co.cask.cdap.dq.DataQualityService

DataQualityService.ValuesLookup - Class in co.cask.cdap.dq

Handler class for Data Quality Combinable Aggregations Service

DataQualityService.ValuesLookup(String) - Constructor for class co.cask.cdap.dq.DataQualityService.ValuesLookup

DataQualitySource - Class in co.cask.cdap.dq

Configuration class used for source of a DataQuality App

DataQualitySource(String, String, Map<String, String>) - Constructor for class co.cask.cdap.dq.DataQualitySource

DataQualityWorkflow - Class in co.cask.cdap.dq

Implements a Workflow action to run the DataQualityApp with a schedule that runs every x minutes (The default is every 5 minutes).

DataQualityWorkflow() - Constructor for class co.cask.cdap.dq.DataQualityWorkflow

DataQualityWritable - Class in co.cask.cdap.dq

Class for Data Quality Writable.

DataQualityWritable() - Constructor for class co.cask.cdap.dq.DataQualityWritable

deserialize(byte[]) - Method in interface co.cask.cdap.dq.functions.BasicAggregationFunction

Deserialize a given value appropriately

deserialize(byte[]) - Method in class co.cask.cdap.dq.functions.DiscreteValuesHistogram

deserialize(byte[]) - Method in class co.cask.cdap.dq.functions.HistogramWithBucketing

deserialize(byte[]) - Method in class co.cask.cdap.dq.functions.Mean

deserialize(byte[]) - Method in class co.cask.cdap.dq.functions.StandardDeviation

deserialize(byte[]) - Method in class co.cask.cdap.dq.functions.UniqueValues

destroy() - Method in class co.cask.cdap.dq.DataQualityApp.AggregationMapper

destroy() - Method in class co.cask.cdap.dq.DataQualityApp.AggregationReducer

DiscreteValuesHistogram - Class in co.cask.cdap.dq.functions

Discrete Values Histogram Aggregation Function

DiscreteValuesHistogram() - Constructor for class co.cask.cdap.dq.functions.DiscreteValuesHistogram

E

equals(Object) - Method in class co.cask.cdap.dq.AggregationTypeValue

equals(Object) - Method in class co.cask.cdap.dq.FieldDetail

F

FieldDetail - Class in co.cask.cdap.dq

FieldDetail objects should contain information about fieldName as well as the aggregations that are applicable to the given field

FieldDetail(String, Set<AggregationTypeValue>) - Constructor for class co.cask.cdap.dq.FieldDetail

fieldsGetter(HttpServiceRequest, HttpServiceResponder, String, long, long) - Method in class co.cask.cdap.dq.DataQualityService.ValuesLookup

Gets the fields that are queryable for a given time range and sourceID for combinable aggregation functions

G

getAggregationTypeName() - Method in class co.cask.cdap.dq.AggregationTypeValue

getAggregationTypeSet() - Method in class co.cask.cdap.dq.FieldDetail

getFieldName() - Method in class co.cask.cdap.dq.FieldDetail

getId() - Method in class co.cask.cdap.dq.DataQualitySource

getName() - Method in class co.cask.cdap.dq.DataQualitySource

getProperties() - Method in class co.cask.cdap.dq.DataQualitySource

getTableRowKey() - Method in class co.cask.cdap.dq.rowkey.AggregationsRowKey

getTableRowKey() - Method in class co.cask.cdap.dq.rowkey.ValuesRowKey

getTimestamp() - Method in class co.cask.cdap.dq.TimestampValue

getTypes() - Method in class co.cask.cdap.dq.DataQualityWritable

getValue() - Method in class co.cask.cdap.dq.TimestampValue

H

hashCode() - Method in class co.cask.cdap.dq.AggregationTypeValue

hashCode() - Method in class co.cask.cdap.dq.FieldDetail

histogram - Variable in class co.cask.cdap.dq.functions.HistogramWithBucketing

HistogramWithBucketing - Class in co.cask.cdap.dq.functions

Aggregation function creates a histogram with custom bucketing for numbers - no categorical data

HistogramWithBucketing() - Constructor for class co.cask.cdap.dq.functions.HistogramWithBucketing

I

initialize(MapReduceContext) - Method in class co.cask.cdap.dq.DataQualityApp.AggregationMapper

initialize(MapReduceContext) - Method in class co.cask.cdap.dq.DataQualityApp.AggregationReducer

initialize() - Method in class co.cask.cdap.dq.DataQualityApp.FieldAggregator

initialize(HttpServiceContext) - Method in class co.cask.cdap.dq.DataQualityService.ValuesLookup

isCombinable() - Method in class co.cask.cdap.dq.AggregationTypeValue

M

map(LongWritable, GenericStreamEventData<StructuredRecord>, Mapper<LongWritable, GenericStreamEventData<StructuredRecord>, Text, DataQualityWritable>.Context) - Method in class co.cask.cdap.dq.DataQualityApp.AggregationMapper

Mean - Class in co.cask.cdap.dq.functions

Average Aggregation Function

Mean() - Constructor for class co.cask.cdap.dq.functions.Mean

R

reduce(Text, Iterable<DataQualityWritable>, Reducer<Text, DataQualityWritable, byte[], Put>.Context) - Method in class co.cask.cdap.dq.DataQualityApp.AggregationReducer

retrieveAggregation() - Method in interface co.cask.cdap.dq.functions.CombinableAggregationFunction

Retrieve a combined aggregation

retrieveAggregation() - Method in class co.cask.cdap.dq.functions.DiscreteValuesHistogram

retrieveAggregation() - Method in class co.cask.cdap.dq.functions.UniqueValues

S

SERVICE_NAME - Static variable in class co.cask.cdap.dq.DataQualityService

StandardDeviation - Class in co.cask.cdap.dq.functions

Streaming standard Deviation Aggregation Function Calculates standard deviation with one pass

StandardDeviation() - Constructor for class co.cask.cdap.dq.functions.StandardDeviation

T

TimestampValue<T> - Class in co.cask.cdap.dq

TimestampValue objects map a given timestamp to a list of values

TimestampValue(long, T) - Constructor for class co.cask.cdap.dq.TimestampValue

toString() - Method in class co.cask.cdap.dq.DataQualitySource

toString() - Method in class co.cask.cdap.dq.FieldDetail

U

UniqueValues - Class in co.cask.cdap.dq.functions

Unique Values Aggregation Function

UniqueValues() - Constructor for class co.cask.cdap.dq.functions.UniqueValues

V

ValuesRowKey - Class in co.cask.cdap.dq.rowkey

Class for constructing tableRowKeys that consist of the byte[] representation of "Values" concatenated with sourcdID, fieldName, and then timestamp.

ValuesRowKey(long, String, String) - Constructor for class co.cask.cdap.dq.rowkey.ValuesRowKey

A B C D E F G H I M R S T U V