co.cask.hydrator.plugin

Class CSVParser

java.lang.Object

co.cask.cdap.etl.api.Transform<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.plugin.CSVParser

All Implemented Interfaces:

co.cask.cdap.etl.api.Destroyable, co.cask.cdap.etl.api.PipelineConfigurable, co.cask.cdap.etl.api.StageLifecycle<co.cask.cdap.etl.api.TransformContext>, co.cask.cdap.etl.api.Transformation<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

public final class CSVParser
extends co.cask.cdap.etl.api.Transform<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Transformation that parses a field as CSV Record into StructuredRecord.

CSVParser supports transforming the input into StructuredRecord Following are different CSV record types that are supported by this transform. User can also define custom delimiter by selecting tht option "Custom".

• DEFAULT
• EXCEL
• RFC4180
• MYSQL
• Tab Delimited and
• Pipe Delimited
• Custom

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CSVParser.Config Configuration for the plugin.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.commons.csv.CSVFormat	PDL

Fields inherited from class co.cask.cdap.etl.api.Transform

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
CSVParser(CSVParser.Config config)

Method Summary

Methods

Modifier and Type	Method and Description
void	configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer configurer)
void	initialize(co.cask.cdap.etl.api.TransformContext context)
void	transform(co.cask.cdap.api.data.format.StructuredRecord in, co.cask.cdap.etl.api.Emitter<co.cask.cdap.api.data.format.StructuredRecord> emitter)

Methods inherited from class co.cask.cdap.etl.api.Transform

destroy, getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PDL

public static final org.apache.commons.csv.CSVFormat PDL

Constructor Detail

CSVParser

public CSVParser(CSVParser.Config config)

Method Detail

configurePipeline

public void configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer configurer)
                       throws IllegalArgumentException

Specified by:

configurePipeline in interface co.cask.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class co.cask.cdap.etl.api.Transform<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

IllegalArgumentException

initialize

public void initialize(co.cask.cdap.etl.api.TransformContext context)
                throws Exception

Specified by:

initialize in interface co.cask.cdap.etl.api.StageLifecycle<co.cask.cdap.etl.api.TransformContext>

Overrides:

initialize in class co.cask.cdap.etl.api.Transform<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception

transform

public void transform(co.cask.cdap.api.data.format.StructuredRecord in,
             co.cask.cdap.etl.api.Emitter<co.cask.cdap.api.data.format.StructuredRecord> emitter)
               throws Exception

Throws:

Exception