org.apache.beam.runners.core

Class GroupAlsoByWindowViaWindowSetDoFn<K,InputT,OutputT,W extends BoundedWindow,RinT extends org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>>

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<RinT,KV<K,OutputT>>

org.apache.beam.runners.core.GroupAlsoByWindowViaWindowSetDoFn<K,InputT,OutputT,W,RinT>

All Implemented Interfaces:

Serializable, HasDisplayData, org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W>

@SystemDoFnInternal
public class GroupAlsoByWindowViaWindowSetDoFn<K,InputT,OutputT,W extends BoundedWindow,RinT extends org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>>
extends DoFn<RinT,KV<K,OutputT>>
implements org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W>

A general GroupAlsoByWindowsDoFn. This delegates all of the logic to the ReduceFnRunner.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.Context, DoFn.ProcessContext, DoFn.RequiresWindowAccess

Field Summary

Fields

Modifier and Type	Field and Description
protected Aggregator<Long,Long>	droppedDueToClosedWindow
protected Aggregator<Long,Long>	droppedDueToLateness

Method Summary

Modifier and Type	Method and Description
DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>>	asDoFn()
static <K,InputT,OutputT,W extends BoundedWindow> DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>>	create(org.apache.beam.sdk.util.WindowingStrategy<?,W> strategy, org.apache.beam.sdk.util.SystemReduceFn<K,InputT,?,OutputT,W> reduceFn)
Aggregator<Long,Long>	getDroppedDueToLatenessAggregator()
void	processElement(DoFn.ProcessContext c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

createAggregator, createAggregator, finishBundle, getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, startBundle

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

droppedDueToClosedWindow

protected final Aggregator<Long,Long> droppedDueToClosedWindow

droppedDueToLateness

protected final Aggregator<Long,Long> droppedDueToLateness

Method Detail

create

public static <K,InputT,OutputT,W extends BoundedWindow> DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>> create(org.apache.beam.sdk.util.WindowingStrategy<?,W> strategy,
                                                                                                                                     org.apache.beam.sdk.util.SystemReduceFn<K,InputT,?,OutputT,W> reduceFn)

processElement

public void processElement(DoFn.ProcessContext c)
                    throws Exception

Specified by:

processElement in class DoFn<RinT extends org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>>

Throws:

Exception

asDoFn

public DoFn<org.apache.beam.sdk.util.KeyedWorkItem<K,InputT>,KV<K,OutputT>> asDoFn()

Specified by:

asDoFn in interface org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W extends BoundedWindow>

getDroppedDueToLatenessAggregator

public Aggregator<Long,Long> getDroppedDueToLatenessAggregator()

Specified by:

getDroppedDueToLatenessAggregator in interface org.apache.beam.sdk.util.DoFnRunner.ReduceFnExecutor<K,InputT,OutputT,W extends BoundedWindow>