| Package | Description |
|---|---|
| co.cask.cdap.etl.api.batch |
Interfaces for Spark plugins.
|
| Modifier and Type | Method and Description |
|---|---|
void |
SparkCompute.initialize(SparkExecutionPluginContext context)
Initialize the plugin.
|
abstract void |
SparkSink.run(SparkExecutionPluginContext context,
org.apache.spark.api.java.JavaRDD<IN> input)
User Spark job which will be executed and is responsible for persisting any data.
|
abstract org.apache.spark.api.java.JavaRDD<OUT> |
SparkCompute.transform(SparkExecutionPluginContext context,
org.apache.spark.api.java.JavaRDD<IN> input)
Transform the input and return the output to be sent to the next stage in the pipeline.
|
Copyright © 2017 Cask Data, Inc. Licensed under the Apache License, Version 2.0.