org.apache.beam.runners.core

Class UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter<T>

java.lang.Object

org.apache.beam.sdk.io.Source<OutputT>

org.apache.beam.sdk.io.UnboundedSource<T,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>>

org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter<T>

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

UnboundedReadFromBoundedSource<T>

public static class UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter<T>
extends UnboundedSource<T,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>>

A BoundedSource to UnboundedSource adapter.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.UnboundedSource

UnboundedSource.CheckpointMark, UnboundedSource.UnboundedReader<OutputT>

Constructor Summary

Constructors

Constructor and Description
BoundedToUnboundedSourceAdapter(BoundedSource<T> boundedSource)

Method Summary

Modifier and Type	Method and Description
org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Reader	createReader(PipelineOptions options, org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T> checkpoint)
List<UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter<T>>	generateInitialSplits(int desiredNumSplits, PipelineOptions options)
Coder<org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>>	getCheckpointMarkCoder()
Coder<T>	getDefaultOutputCoder()
void	validate()

Methods inherited from class org.apache.beam.sdk.io.UnboundedSource

requiresDeduping

Methods inherited from class org.apache.beam.sdk.io.Source

populateDisplayData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BoundedToUnboundedSourceAdapter

public BoundedToUnboundedSourceAdapter(BoundedSource<T> boundedSource)

Method Detail

validate

public void validate()

Specified by:

validate in class Source<T>

generateInitialSplits

public List<UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter<T>> generateInitialSplits(int desiredNumSplits,
                                                                                                     PipelineOptions options)
                                                                                              throws Exception

Specified by:

generateInitialSplits in class UnboundedSource<T,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>>

Throws:

Exception

createReader

public org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Reader createReader(PipelineOptions options,
                                                                                                                       org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T> checkpoint)
                                                                                                                throws IOException

Specified by:

createReader in class UnboundedSource<T,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>>

Throws:

IOException

getDefaultOutputCoder

public Coder<T> getDefaultOutputCoder()

Specified by:

getDefaultOutputCoder in class Source<T>

getCheckpointMarkCoder

public Coder<org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>> getCheckpointMarkCoder()

Specified by:

getCheckpointMarkCoder in class UnboundedSource<T,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Checkpoint<T>>