org.apache.beam.runners.core

Class GroupAlsoByWindowViaWindowSetDoFn<K,InputT,OutputT,W extends BoundedWindow,RinT extends org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>>

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<RinT,KV<K,OutputT>>

org.apache.beam.runners.core.GroupAlsoByWindowViaWindowSetDoFn<K,InputT,OutputT,W,RinT>

All Implemented Interfaces:

Serializable, HasDisplayData, org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W>

@SystemDoFnInternal
public class GroupAlsoByWindowViaWindowSetDoFn<K,InputT,OutputT,W extends BoundedWindow,RinT extends org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>>
extends DoFn<RinT,KV<K,OutputT>>
implements org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W>

A general GroupAlsoByWindowsDoFn. This delegates all of the logic to the ReduceFnRunner.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.Context, DoFn.ProcessContext, DoFn.RequiresWindowAccess

Field Summary

Fields

Modifier and Type	Field and Description
protected Aggregator<Long,Long>	droppedDueToClosedWindow
protected Aggregator<Long,Long>	droppedDueToLateness

Method Summary

Modifier and Type	Method and Description
DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>>	asDoFn() Gets this object as a DoFn.
static <K,InputT,OutputT,W extends BoundedWindow> DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>>	create(org.apache.beam.sdk.util.WindowingStrategy<?,W> strategy, org.apache.beam.sdk.util.state.StateInternalsFactory<K> stateInternalsFactory, org.apache.beam.sdk.util.SystemReduceFn<K,InputT,?,OutputT,W> reduceFn)
Aggregator<Long,Long>	getDroppedDueToLatenessAggregator() Returns an aggregator that tracks elements that are dropped due to being late.
void	processElement(DoFn.ProcessContext c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

createAggregator, createAggregator, finishBundle, getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, startBundle

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

droppedDueToClosedWindow

protected final Aggregator<Long,Long> droppedDueToClosedWindow

droppedDueToLateness

protected final Aggregator<Long,Long> droppedDueToLateness

Method Detail

create

public static <K,InputT,OutputT,W extends BoundedWindow> DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>> create(org.apache.beam.sdk.util.WindowingStrategy<?,W> strategy,
                                                                                                                                     org.apache.beam.sdk.util.state.StateInternalsFactory<K> stateInternalsFactory,
                                                                                                                                     org.apache.beam.sdk.util.SystemReduceFn<K,InputT,?,OutputT,W> reduceFn)

processElement

public void processElement(DoFn.ProcessContext c)
                    throws Exception

Specified by:

processElement in class DoFn<RinT extends org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>>

Throws:

Exception

asDoFn

public DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>> asDoFn()

Description copied from interface: org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor

Gets this object as a DoFn. Most implementors of this interface are expected to be DoFn instances, and will return themselves.

Specified by:

asDoFn in interface org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W extends BoundedWindow>

getDroppedDueToLatenessAggregator

public Aggregator<Long,Long> getDroppedDueToLatenessAggregator()

Description copied from interface: org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor

Returns an aggregator that tracks elements that are dropped due to being late.

Specified by:

getDroppedDueToLatenessAggregator in interface org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W extends BoundedWindow>