co.cask.cdap.api.spark

Interface ExtendedSparkConfigurer

All Superinterfaces:

DatasetConfigurer, PluginConfigurer, ProgramConfigurer, SparkConfigurer

public interface ExtendedSparkConfigurer
extends SparkConfigurer

Extends the functionality of SparkConfigurer to provide more spark specific feature at configuration time.

Method Summary

Modifier and Type	Method and Description
co.cask.cdap.api.spark.dynamic.SparkCompiler	createSparkCompiler() Creates a new instance of SparkCompiler for Scala code compilation.

Methods inherited from interface co.cask.cdap.api.spark.SparkConfigurer

setClientResources, setDriverResources, setExecutorResources, setMainClassName

Methods inherited from interface co.cask.cdap.api.ProgramConfigurer

setDescription, setName, setProperties

Methods inherited from interface co.cask.cdap.api.plugin.PluginConfigurer

usePlugin, usePlugin, usePluginClass, usePluginClass

Methods inherited from interface co.cask.cdap.api.DatasetConfigurer

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Method Detail

createSparkCompiler

co.cask.cdap.api.spark.dynamic.SparkCompiler createSparkCompiler()

Creates a new instance of SparkCompiler for Scala code compilation.

Returns:

a new instance of SparkCompiler.