co.cask.cdap.etl.api.batch

Interface SparkPluginContext

All Superinterfaces:

BatchContext, DatasetContext, LookupProvider, StageContext, TransformContext

@Beta
public interface SparkPluginContext
extends BatchContext

Context passed to spark plugin types during prepare run phase.

Method Summary

Methods

Modifier and Type	Method and Description
void	setSparkConf(org.apache.spark.SparkConf sparkConf) Sets a SparkConf to be used for the Spark execution.

Methods inherited from interface co.cask.cdap.etl.api.batch.BatchContext

createDataset, datasetExists, getHadoopJob, getLogicalStartTime, getRuntimeArguments, setRuntimeArgument

Methods inherited from interface co.cask.cdap.api.data.DatasetContext

discardDataset, getDataset, getDataset, getDataset, getDataset, releaseDataset

Methods inherited from interface co.cask.cdap.etl.api.StageContext

getMetrics, getPluginProperties, getPluginProperties, getStageName, loadPluginClass, newPluginInstance

Methods inherited from interface co.cask.cdap.etl.api.LookupProvider

provide

Method Detail

setSparkConf

void setSparkConf(org.apache.spark.SparkConf sparkConf)

Sets a SparkConf to be used for the Spark execution.