A B C D E F G H I J K L M N O P R S T U V W

A

apply(WindowFunction.Context<T2>) - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.GearpumpWindowFn

B

BoundedSourceWrapper<T> - Class in org.apache.beam.runners.gearpump.translators.io

wrapper over BoundedSource for Gearpump DataSource API.

BoundedSourceWrapper(BoundedSource<T>, PipelineOptions) - Constructor for class org.apache.beam.runners.gearpump.translators.io.BoundedSourceWrapper

boundedWindowToGearpumpWindow(BoundedWindow) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

C

cancel() - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult

close() - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource

CreateGearpumpPCollectionViewTranslator<ElemT,ViewT> - Class in org.apache.beam.runners.gearpump.translators

CreateGearpumpPCollectionView bridges input stream to down stream transforms.

CreateGearpumpPCollectionViewTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.CreateGearpumpPCollectionViewTranslator

createReader(PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.BoundedSourceWrapper

createReader(PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource

createReader(PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.UnboundedSourceWrapper

createReader(PipelineOptions, UnboundedSource.CheckpointMark) - Method in class org.apache.beam.runners.gearpump.translators.io.ValuesSource

createRunner(ReadyCheckingSideInputReader) - Method in class org.apache.beam.runners.gearpump.translators.utils.DoFnRunnerFactory

D

DoFnFunction<InputT,OutputT> - Class in org.apache.beam.runners.gearpump.translators.functions

Gearpump FlatMapFunction wrapper over Beam DoFn.

DoFnFunction(GearpumpPipelineOptions, DoFn<InputT, OutputT>, WindowingStrategy<?, ?>, Collection<PCollectionView<?>>, Map<String, PCollectionView<?>>, TupleTag<OutputT>, Map<TupleTag<?>, Coder<?>>, List<TupleTag<?>>, DoFnSchemaInformation) - Constructor for class org.apache.beam.runners.gearpump.translators.functions.DoFnFunction

DoFnRunnerFactory<InputT,OutputT> - Class in org.apache.beam.runners.gearpump.translators.utils

a serializable SimpleDoFnRunner.

DoFnRunnerFactory(GearpumpPipelineOptions, DoFn<InputT, OutputT>, Collection<PCollectionView<?>>, DoFnRunners.OutputManager, TupleTag<OutputT>, List<TupleTag<?>>, StepContext, Map<TupleTag<?>, Coder<?>>, WindowingStrategy<?, ?>, DoFnSchemaInformation) - Constructor for class org.apache.beam.runners.gearpump.translators.utils.DoFnRunnerFactory

E

enterCompositeTransform(TransformHierarchy.Node) - Method in class org.apache.beam.runners.gearpump.translators.GearpumpPipelineTranslator

equals(Object) - Method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.RawUnionValue

F

flatMap(List<TranslatorUtils.RawUnionValue>) - Method in class org.apache.beam.runners.gearpump.translators.functions.DoFnFunction

flatMap(WindowedValue<T>) - Method in class org.apache.beam.runners.gearpump.translators.WindowAssignTranslator.AssignWindows

FlattenPCollectionsTranslator<T> - Class in org.apache.beam.runners.gearpump.translators

Flatten.FlattenPCollectionList is translated to Gearpump merge function.

FlattenPCollectionsTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.FlattenPCollectionsTranslator

fold(KV<Instant, WindowedValue<KV<K, List<V>>>>, KV<Instant, WindowedValue<KV<K, V>>>) - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.Merge

fromOptions(PipelineOptions) - Static method in class org.apache.beam.runners.gearpump.GearpumpRunner

fromOptions(PipelineOptions) - Static method in class org.apache.beam.runners.gearpump.TestGearpumpRunner

FromRawUnionValue() - Constructor for class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.FromRawUnionValue

G

GearpumpPipelineOptions - Interface in org.apache.beam.runners.gearpump

Options that configure the Gearpump pipeline.

GearpumpPipelineResult - Class in org.apache.beam.runners.gearpump

Result of executing a Pipeline with Gearpump.

GearpumpPipelineResult(ClientContext, RunningApplication) - Constructor for class org.apache.beam.runners.gearpump.GearpumpPipelineResult

GearpumpPipelineTranslator - Class in org.apache.beam.runners.gearpump.translators

GearpumpPipelineTranslator knows how to translate Pipeline objects into Gearpump Graph.

GearpumpPipelineTranslator(TranslationContext) - Constructor for class org.apache.beam.runners.gearpump.translators.GearpumpPipelineTranslator

GearpumpRunner - Class in org.apache.beam.runners.gearpump

A PipelineRunner that executes the operations in the pipeline by first translating them to Gearpump Stream DSL and then executing them on a Gearpump cluster.

GearpumpRunner(GearpumpPipelineOptions) - Constructor for class org.apache.beam.runners.gearpump.GearpumpRunner

GearpumpRunnerRegistrar - Class in org.apache.beam.runners.gearpump

Contains the PipelineRunnerRegistrar and PipelineOptionsRegistrar for the GearpumpRunner.

GearpumpRunnerRegistrar.Options - Class in org.apache.beam.runners.gearpump

Registers the GearpumpPipelineOptions.

GearpumpRunnerRegistrar.Runner - Class in org.apache.beam.runners.gearpump

Registers the GearpumpRunner.

GearpumpSource<T> - Class in org.apache.beam.runners.gearpump.translators.io

common methods for BoundedSourceWrapper and UnboundedSourceWrapper.

GearpumpWindowFn(boolean) - Constructor for class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.GearpumpWindowFn

getApplicationName() - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

getCheckpointMarkCoder() - Method in class org.apache.beam.runners.gearpump.translators.io.ValuesSource

getClientContext() - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

getClientContext() - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult

getCurrentTransform() - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getDefaultOutputCoder() - Method in class org.apache.beam.runners.gearpump.translators.io.ValuesSource

getInput() - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getInputs() - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getInputStream(PValue) - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getOutput() - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getOutputs() - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getParallelism() - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

getPipelineOptions() - Method in class org.apache.beam.runners.gearpump.GearpumpRunnerRegistrar.Options

getPipelineOptions() - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getPipelineRunners() - Method in class org.apache.beam.runners.gearpump.GearpumpRunnerRegistrar.Runner

getRemote() - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

getSerializers() - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

getSourceStream(DataSource) - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

getState() - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult

getTagsToSideInputs(Collection<PCollectionView<?>>) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

getUnionTag() - Method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.RawUnionValue

getValue() - Method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.RawUnionValue

getWatermark() - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource

groupBy(WindowedValue<KV<K, V>>) - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.GroupByFn

GroupByKeyTranslator<K,V> - Class in org.apache.beam.runners.gearpump.translators

GroupByKey is translated to Gearpump groupBy function.

GroupByKeyTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator

GroupByKeyTranslator.GearpumpWindowFn<T,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow> - Class in org.apache.beam.runners.gearpump.translators

A transform used internally to translate Beam's Window to Gearpump's Window.

GroupByKeyTranslator.GroupByFn<K,V> - Class in org.apache.beam.runners.gearpump.translators

A transform used internally to group KV message by its key.

GroupByKeyTranslator.KeyedByTimestamp<K,V> - Class in org.apache.beam.runners.gearpump.translators

A transform used internally to transform WindowedValue to KV.

GroupByKeyTranslator.Merge<K,V> - Class in org.apache.beam.runners.gearpump.translators

A transform used internally by Gearpump which encapsulates the merge logic.

H

hashCode() - Method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.RawUnionValue

I

init() - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.Merge

isNonMerging() - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.GearpumpWindowFn

J

java8TimeToJodaTime(Instant) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

jodaTimeToJava8Time(Instant) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

K

KeyedByTimestamp(WindowFn<KV<K, V>, BoundedWindow>, TimestampCombiner) - Constructor for class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.KeyedByTimestamp

L

leaveCompositeTransform(TransformHierarchy.Node) - Method in class org.apache.beam.runners.gearpump.translators.GearpumpPipelineTranslator

M

map(WindowedValue<KV<K, V>>) - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.KeyedByTimestamp

map(TranslatorUtils.RawUnionValue) - Method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.FromRawUnionValue

metrics() - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult

N

NoOpStepContext - Class in org.apache.beam.runners.gearpump.translators.utils

serializable StepContext that basically does nothing.

NoOpStepContext() - Constructor for class org.apache.beam.runners.gearpump.translators.utils.NoOpStepContext

O

open(TaskContext, Instant) - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource

Options() - Constructor for class org.apache.beam.runners.gearpump.GearpumpRunnerRegistrar.Options

org.apache.beam.runners.gearpump - package org.apache.beam.runners.gearpump

Internal implementation of the Beam runner for Apache Gearpump.

org.apache.beam.runners.gearpump.translators - package org.apache.beam.runners.gearpump.translators

Gearpump specific translators.

org.apache.beam.runners.gearpump.translators.functions - package org.apache.beam.runners.gearpump.translators.functions

Gearpump specific wrappers for Beam DoFn.

org.apache.beam.runners.gearpump.translators.io - package org.apache.beam.runners.gearpump.translators.io

Gearpump specific wrappers for Beam I/O.

org.apache.beam.runners.gearpump.translators.utils - package org.apache.beam.runners.gearpump.translators.utils

Utilities for translators.

P

ParDoMultiOutputTranslator<InputT,OutputT> - Class in org.apache.beam.runners.gearpump.translators

ParDo.MultiOutput is translated to Gearpump flatMap function with DoFn wrapped in DoFnFunction.

ParDoMultiOutputTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.ParDoMultiOutputTranslator

R

RawUnionValue(String, Object) - Constructor for class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.RawUnionValue

Constructs a partial union from the given union tag and value.

read() - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource

ReadBoundedTranslator<T> - Class in org.apache.beam.runners.gearpump.translators

Read.Bounded is translated to Gearpump source function and BoundedSource is wrapped into Gearpump DataSource.

ReadBoundedTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.ReadBoundedTranslator

ReadUnboundedTranslator<T> - Class in org.apache.beam.runners.gearpump.translators

Read.Unbounded is translated to Gearpump source function and UnboundedSource is wrapped into Gearpump DataSource.

ReadUnboundedTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.ReadUnboundedTranslator

run(Pipeline) - Method in class org.apache.beam.runners.gearpump.GearpumpRunner

run(Pipeline) - Method in class org.apache.beam.runners.gearpump.TestGearpumpRunner

Runner() - Constructor for class org.apache.beam.runners.gearpump.GearpumpRunnerRegistrar.Runner

S

setApplicationName(String) - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

setClientContext(ClientContext) - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

setCurrentTransform(TransformHierarchy.Node, Pipeline) - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

setOutputStream(PValue, JavaStream<OutputT>) - Method in class org.apache.beam.runners.gearpump.translators.TranslationContext

setParallelism(int) - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

setRemote(Boolean) - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

setSerializers(Map<String, String>) - Method in interface org.apache.beam.runners.gearpump.GearpumpPipelineOptions

setup() - Method in class org.apache.beam.runners.gearpump.translators.functions.DoFnFunction

split(int, PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.ValuesSource

stateInternals() - Method in class org.apache.beam.runners.gearpump.translators.utils.NoOpStepContext

T

teardown() - Method in class org.apache.beam.runners.gearpump.translators.functions.DoFnFunction

TestGearpumpRunner - Class in org.apache.beam.runners.gearpump

Gearpump PipelineRunner for tests, which uses EmbeddedCluster.

timerInternals() - Method in class org.apache.beam.runners.gearpump.translators.utils.NoOpStepContext

toList(JavaStream<TranslatorUtils.RawUnionValue>) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

toString() - Method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils.RawUnionValue

TransformTranslator<T extends org.apache.beam.sdk.transforms.PTransform> - Interface in org.apache.beam.runners.gearpump.translators

Translates PTransform to Gearpump functions.

translate(CreateStreamingGearpumpView.CreateGearpumpPCollectionView<ElemT, ViewT>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.CreateGearpumpPCollectionViewTranslator

translate(Flatten.PCollections<T>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.FlattenPCollectionsTranslator

translate(Pipeline) - Method in class org.apache.beam.runners.gearpump.translators.GearpumpPipelineTranslator

translate(GroupByKey<K, V>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator

translate(ParDo.MultiOutput<InputT, OutputT>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.ParDoMultiOutputTranslator

translate(Read.Bounded<T>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.ReadBoundedTranslator

translate(Read.Unbounded<T>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.ReadUnboundedTranslator

translate(T, TranslationContext) - Method in interface org.apache.beam.runners.gearpump.translators.TransformTranslator

translate(Window.Assign<T>, TranslationContext) - Method in class org.apache.beam.runners.gearpump.translators.WindowAssignTranslator

TranslationContext - Class in org.apache.beam.runners.gearpump.translators

Maintains context data for TransformTranslators.

TranslationContext(JavaStreamApp, GearpumpPipelineOptions) - Constructor for class org.apache.beam.runners.gearpump.translators.TranslationContext

TranslatorUtils - Class in org.apache.beam.runners.gearpump.translators.utils

Utility methods for translators.

TranslatorUtils() - Constructor for class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

TranslatorUtils.FromRawUnionValue<OutputT> - Class in org.apache.beam.runners.gearpump.translators.utils

Converts @link{RawUnionValue} to @link{WindowedValue}.

TranslatorUtils.RawUnionValue - Class in org.apache.beam.runners.gearpump.translators.utils

This is copied from org.apache.beam.sdk.transforms.join.RawUnionValue.

U

UnboundedSourceWrapper<OutputT,CheckpointMarkT extends org.apache.beam.sdk.io.UnboundedSource.CheckpointMark> - Class in org.apache.beam.runners.gearpump.translators.io

wrapper over UnboundedSource for Gearpump DataSource API.

UnboundedSourceWrapper(UnboundedSource<OutputT, CheckpointMarkT>, PipelineOptions) - Constructor for class org.apache.beam.runners.gearpump.translators.io.UnboundedSourceWrapper

V

ValuesSource<T> - Class in org.apache.beam.runners.gearpump.translators.io

unbounded source that reads from a Java Iterable.

ValuesSource(Iterable<T>, Coder<T>) - Constructor for class org.apache.beam.runners.gearpump.translators.io.ValuesSource

visitPrimitiveTransform(TransformHierarchy.Node) - Method in class org.apache.beam.runners.gearpump.translators.GearpumpPipelineTranslator

visitValue(PValue, TransformHierarchy.Node) - Method in class org.apache.beam.runners.gearpump.translators.GearpumpPipelineTranslator

W

waitUntilFinish(Duration) - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult

waitUntilFinish() - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult

WindowAssignTranslator<T> - Class in org.apache.beam.runners.gearpump.translators

Window.Assign is translated to Gearpump flatMap function.

WindowAssignTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.WindowAssignTranslator

WindowAssignTranslator.AssignWindows<T> - Class in org.apache.beam.runners.gearpump.translators

A Function used internally by Gearpump to wrap the actual Beam's WindowFn.

withSideInputStream(TranslationContext, JavaStream<WindowedValue<InputT>>, Map<String, PCollectionView<?>>) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils

A B C D E F G H I J K L M N O P R S T U V W