co.cask.format.avro.output

Class StructuredAvroOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.format.output.DelegatingOutputFormat<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>

co.cask.format.avro.output.StructuredAvroOutputFormat

public class StructuredAvroOutputFormat
extends DelegatingOutputFormat<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>

Converts StructuredRecord into GenericRecord before delegating to AvroKeyOutputFormat.

Constructor Summary

Constructors

Constructor and Description
StructuredAvroOutputFormat()

Method Summary

Modifier and Type	Method and Description
protected org.apache.hadoop.mapreduce.OutputFormat<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>	createDelegate()
protected java.util.function.Function<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.dataset.lib.KeyValue<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>>	getConversion(org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class co.cask.hydrator.format.output.DelegatingOutputFormat

checkOutputSpecs, getOutputCommitter, getRecordWriter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StructuredAvroOutputFormat

public StructuredAvroOutputFormat()

Method Detail

createDelegate

protected org.apache.hadoop.mapreduce.OutputFormat<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable> createDelegate()

Specified by:

createDelegate in class DelegatingOutputFormat<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>

getConversion

protected java.util.function.Function<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.dataset.lib.KeyValue<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>> getConversion(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                                                                                                                                                           throws IOException

Specified by:

getConversion in class DelegatingOutputFormat<org.apache.avro.mapred.AvroKey<org.apache.avro.generic.GenericRecord>,org.apache.hadoop.io.NullWritable>

Throws:

IOException