co.cask.cdap.api.spark

Interface ExtendedSparkConfigurer

All Superinterfaces:

DatasetConfigurer, PluginConfigurer, ProgramConfigurer, SparkConfigurer

public interface ExtendedSparkConfigurer
extends SparkConfigurer

Extends the functionality of SparkConfigurer to provide more spark specific feature at configuration time.

Method Summary

Modifier and Type	Method and Description
void	addHandlers(Iterable<? extends SparkHttpServiceHandler> handlers) Adds a list of SparkHttpServiceHandlers to runs in the Spark driver.
default void	addHandlers(SparkHttpServiceHandler... handlers) Adds a list of SparkHttpServiceHandlers to runs in the Spark driver.
co.cask.cdap.api.spark.dynamic.SparkCompiler	createSparkCompiler() Creates a new instance of SparkCompiler for Scala code compilation.

Methods inherited from interface co.cask.cdap.api.spark.SparkConfigurer

setClientResources, setDriverResources, setExecutorResources, setMainClassName

Methods inherited from interface co.cask.cdap.api.ProgramConfigurer

setDescription, setName, setProperties

Methods inherited from interface co.cask.cdap.api.DatasetConfigurer

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Methods inherited from interface co.cask.cdap.api.plugin.PluginConfigurer

usePlugin, usePlugin, usePluginClass, usePluginClass

Method Detail

createSparkCompiler

co.cask.cdap.api.spark.dynamic.SparkCompiler createSparkCompiler()

Creates a new instance of SparkCompiler for Scala code compilation.

Returns:

a new instance of SparkCompiler.

addHandlers

default void addHandlers(SparkHttpServiceHandler... handlers)

Adds a list of SparkHttpServiceHandlers to runs in the Spark driver.

See Also:

SparkHttpServiceHandler

addHandlers

void addHandlers(Iterable<? extends SparkHttpServiceHandler> handlers)

Adds a list of SparkHttpServiceHandlers to runs in the Spark driver.

See Also:

SparkHttpServiceHandler