C F G J R S

C

co.cask.cdap.api.spark - package co.cask.cdap.api.spark

F

fromDataset(String) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD from the given Dataset.

fromDataset(String, Map<String, String>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD from the given Dataset with the given set of Dataset arguments.

fromDataset(String, Map<String, String>, Iterable<? extends Split>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD from the given Dataset with the given set of Dataset arguments and custom list of Splits.

fromStream(String) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaRDD that represents all events from the given stream.

fromStream(String, long, long) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaRDD that represents events from the given stream in the given time range.

fromStream(String, Class<V>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD that represents all events from the given stream.

fromStream(String, long, long, Class<V>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD that represents events from the given stream in the given time range.

fromStream(String, long, long, Class<? extends StreamEventDecoder<K, V>>, Class<K>, Class<V>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD that represents events from the given stream in the given time range.

fromStream(String, FormatSpecification, Class<T>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD that represents all events from the given stream.

fromStream(String, FormatSpecification, long, long, Class<T>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Creates a JavaPairRDD that represents data from the given stream for events in the given time range.

G

getLocalizationContext() - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Returns a Serializable TaskLocalizationContext which can be used to retrieve files localized to task containers.

getLogicalStartTime() - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Returns the logical start time of this Spark job.

getMetrics() - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Returns a Serializable Metrics which can be used to emit custom metrics from user's Spark program.

getPluginContext() - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Returns a Serializable PluginContext which can be used to request for plugins instances.

getServiceDiscoverer() - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Returns a Serializable ServiceDiscoverer for Service Discovery in Spark Program which can be passed in Spark program's closures.

getSpecification() - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

J

JavaSparkExecutionContext - Class in co.cask.cdap.api.spark

Spark program execution context.

JavaSparkExecutionContext() - Constructor for class co.cask.cdap.api.spark.JavaSparkExecutionContext

JavaSparkMain - Interface in co.cask.cdap.api.spark

A Java interface for Spark program to implement.

R

run(JavaSparkExecutionContext) - Method in interface co.cask.cdap.api.spark.JavaSparkMain

This method will be called when the Spark program starts.

S

saveAsDataset(JavaPairRDD<K, V>, String) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Saves the given JavaPairRDD to the given Dataset.

saveAsDataset(JavaPairRDD<K, V>, String, Map<String, String>) - Method in class co.cask.cdap.api.spark.JavaSparkExecutionContext

Saves the given JavaPairRDD to the given Dataset with the given set of Dataset arguments.

C F G J R S