co.cask.cdap.conversion.app

Class StreamConversionMapReduce

java.lang.Object

co.cask.cdap.api.mapreduce.AbstractMapReduce

co.cask.cdap.conversion.app.StreamConversionMapReduce

All Implemented Interfaces:

MapReduce

public class StreamConversionMapReduce
extends AbstractMapReduce

MapReduce job that reads events from a stream over a given time interval and writes the events out to files in avro format, as well as registering those files as partitions in Hive.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StreamConversionMapReduce.StreamConversionMapper Mapper that reads events from a stream and writes them out as Avro.

Field Summary

Fields

Modifier and Type	Field and Description
static String	ADAPTER_PROPERTIES
static String	HEADERS_KEY
static String	SCHEMA_KEY

Constructor Summary

Constructors

Constructor and Description
StreamConversionMapReduce()

Method Summary

Methods

Modifier and Type	Method and Description
void	beforeSubmit(MapReduceContext context)
void	configure()
void	onFinish(boolean succeeded, MapReduceContext context)

Methods inherited from class co.cask.cdap.api.mapreduce.AbstractMapReduce

configure, getConfigurer, setDescription, setInputDataset, setMapperResources, setName, setOutputDataset, setProperties, setReducerResources, useDatasets, useDatasets, useStreamInput, useStreamInput, useStreamInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ADAPTER_PROPERTIES

public static final String ADAPTER_PROPERTIES

See Also:

Constant Field Values

SCHEMA_KEY

public static final String SCHEMA_KEY

See Also:

Constant Field Values

HEADERS_KEY

public static final String HEADERS_KEY

See Also:

Constant Field Values

Constructor Detail

StreamConversionMapReduce

public StreamConversionMapReduce()

Method Detail

configure

public void configure()

Overrides:

configure in class AbstractMapReduce

beforeSubmit

public void beforeSubmit(MapReduceContext context)
                  throws Exception

Specified by:

beforeSubmit in interface MapReduce

Overrides:

beforeSubmit in class AbstractMapReduce

Throws:

Exception

onFinish

public void onFinish(boolean succeeded,
            MapReduceContext context)
              throws Exception

Specified by:

onFinish in interface MapReduce

Overrides:

onFinish in class AbstractMapReduce

Throws:

Exception