co.cask.hydrator.plugin.batch.source

Class BatchCassandraSource

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.BatchSourceContext>

co.cask.cdap.etl.api.batch.BatchSource<Long,com.datastax.driver.core.Row,co.cask.cdap.api.data.format.StructuredRecord>

co.cask.hydrator.plugin.batch.source.BatchCassandraSource

All Implemented Interfaces:

co.cask.cdap.etl.api.Destroyable, co.cask.cdap.etl.api.PipelineConfigurable, co.cask.cdap.etl.api.StageLifecycle<co.cask.cdap.etl.api.batch.BatchRuntimeContext>, co.cask.cdap.etl.api.Transformation<co.cask.cdap.api.dataset.lib.KeyValue<Long,com.datastax.driver.core.Row>,co.cask.cdap.api.data.format.StructuredRecord>

public class BatchCassandraSource
extends co.cask.cdap.etl.api.batch.BatchSource<Long,com.datastax.driver.core.Row,co.cask.cdap.api.data.format.StructuredRecord>

Batch source for Cassandra.

Note that one mapper will be created for each token. The default number of tokens is 256, so a Map-Reduce job will run with 257 mappers, even for small datasets.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BatchCassandraSource.Cassandra Properties for Cassandra
static class	BatchCassandraSource.CassandraSourceConfig Config class for Batch Cassandra Config

Constructor Summary

Constructors

Constructor and Description
BatchCassandraSource(BatchCassandraSource.CassandraSourceConfig config)

Method Summary

Methods

Modifier and Type	Method and Description
void	configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)
void	prepareRun(co.cask.cdap.etl.api.batch.BatchSourceContext context)
void	transform(co.cask.cdap.api.dataset.lib.KeyValue<Long,com.datastax.driver.core.Row> input, co.cask.cdap.etl.api.Emitter<co.cask.cdap.api.data.format.StructuredRecord> emitter)

Methods inherited from class co.cask.cdap.etl.api.batch.BatchSource

destroy, initialize

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchCassandraSource

public BatchCassandraSource(BatchCassandraSource.CassandraSourceConfig config)

Method Detail

configurePipeline

public void configurePipeline(co.cask.cdap.etl.api.PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface co.cask.cdap.etl.api.PipelineConfigurable

Overrides:

configurePipeline in class co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.BatchSourceContext>

prepareRun

public void prepareRun(co.cask.cdap.etl.api.batch.BatchSourceContext context)
                throws Exception

Specified by:

prepareRun in class co.cask.cdap.etl.api.batch.BatchConfigurable<co.cask.cdap.etl.api.batch.BatchSourceContext>

Throws:

Exception

transform

public void transform(co.cask.cdap.api.dataset.lib.KeyValue<Long,com.datastax.driver.core.Row> input,
             co.cask.cdap.etl.api.Emitter<co.cask.cdap.api.data.format.StructuredRecord> emitter)
               throws Exception

Specified by:

transform in interface co.cask.cdap.etl.api.Transformation<co.cask.cdap.api.dataset.lib.KeyValue<Long,com.datastax.driver.core.Row>,co.cask.cdap.api.data.format.StructuredRecord>

Overrides:

transform in class co.cask.cdap.etl.api.batch.BatchSource<Long,com.datastax.driver.core.Row,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception