A B C D E F G I J L M O P R S T W

A

apply(PCollection<String>) - Method in class org.apache.beam.examples.complete.AutoComplete.ComputeTopCompletions

apply(PCollection<KV<URI, String>>) - Method in class org.apache.beam.examples.complete.TfIdf.ComputeTfIdf

apply(PBegin) - Method in class org.apache.beam.examples.complete.TfIdf.ReadDocuments

apply(PCollection<KV<String, KV<URI, Double>>>) - Method in class org.apache.beam.examples.complete.TfIdf.WriteTfIdf

apply(Iterable<TrafficMaxLaneFlow.LaneInfo>) - Method in class org.apache.beam.examples.complete.TrafficMaxLaneFlow.MaxFlow

apply(Iterable<String>) - Method in class org.apache.beam.examples.cookbook.CombinePerKeyExamples.ConcatWords

apply(PCollection<String>) - Method in class org.apache.beam.examples.WordCount.CountWords

apply(KV<String, Long>) - Method in class org.apache.beam.examples.WordCount.FormatAsTextFn

AutoComplete - Class in org.apache.beam.examples.complete

An example that computes the most popular hash tags for every prefix, which can be used for auto-completion.

AutoComplete() - Constructor for class org.apache.beam.examples.complete.AutoComplete

AutoComplete.ComputeTopCompletions - Class in org.apache.beam.examples.complete

A PTransform that takes as input a list of tokens and returns the most common tokens per prefix.

B

BigQueryTableFactory() - Constructor for class org.apache.beam.examples.common.ExampleBigQueryTableOptions.BigQueryTableFactory

BigQueryTornadoes - Class in org.apache.beam.examples.cookbook

An example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.

BigQueryTornadoes() - Constructor for class org.apache.beam.examples.cookbook.BigQueryTornadoes

C

CombinePerKeyExamples - Class in org.apache.beam.examples.cookbook

An example that reads the public 'Shakespeare' data, and for each word in the dataset that is over a given length, generates a string containing the list of play names in which that word appears, and saves this information to a bigquery table.

CombinePerKeyExamples() - Constructor for class org.apache.beam.examples.cookbook.CombinePerKeyExamples

CombinePerKeyExamples.ConcatWords - Class in org.apache.beam.examples.cookbook

A 'combine function' used with the Combine.perKey transform.

ComputeTfIdf() - Constructor for class org.apache.beam.examples.complete.TfIdf.ComputeTfIdf

ComputeTopCompletions(int, boolean) - Constructor for class org.apache.beam.examples.complete.AutoComplete.ComputeTopCompletions

ConcatWords() - Constructor for class org.apache.beam.examples.cookbook.CombinePerKeyExamples.ConcatWords

CountWords() - Constructor for class org.apache.beam.examples.WordCount.CountWords

create(PipelineOptions) - Method in class org.apache.beam.examples.common.ExampleBigQueryTableOptions.BigQueryTableFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions.PubsubSubscriptionFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.common.ExamplePubsubTopicOptions.PubsubTopicFactory

create(PipelineOptions) - Method in class org.apache.beam.examples.WordCount.WordCountOptions.OutputFactory

D

DebuggingWordCount - Class in org.apache.beam.examples

An example that verifies word counts in Shakespeare and includes Beam best practices.

DebuggingWordCount() - Constructor for class org.apache.beam.examples.DebuggingWordCount

DebuggingWordCount.FilterTextFn - Class in org.apache.beam.examples

A DoFn that filters for a specific key based upon a regular expression.

DebuggingWordCount.WordCountOptions - Interface in org.apache.beam.examples

Options supported by DebuggingWordCount.

DeDupExample - Class in org.apache.beam.examples.cookbook

This example uses as input Shakespeare's plays as plaintext files, and will remove any duplicate lines across all the files.

DeDupExample() - Constructor for class org.apache.beam.examples.cookbook.DeDupExample

E

ExampleBigQueryTableOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure BigQuery tables in Beam examples.

ExampleBigQueryTableOptions.BigQueryTableFactory - Class in org.apache.beam.examples.common

Returns the job name as the default BigQuery table name.

ExampleOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure the Beam examples.

ExamplePubsubTopicAndSubscriptionOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure Pub/Sub topic/subscription in Beam examples.

ExamplePubsubTopicAndSubscriptionOptions.PubsubSubscriptionFactory - Class in org.apache.beam.examples.common

Returns a default Pub/Sub subscription based on the project and the job names.

ExamplePubsubTopicOptions - Interface in org.apache.beam.examples.common

Options that can be used to configure Pub/Sub topic in Beam examples.

ExamplePubsubTopicOptions.PubsubTopicFactory - Class in org.apache.beam.examples.common

Returns a default Pub/Sub topic based on the project and the job names.

ExampleUtils - Class in org.apache.beam.examples.common

The utility class that sets up and tears down external resources, and cancels the streaming pipelines once the program terminates.

ExampleUtils(PipelineOptions) - Constructor for class org.apache.beam.examples.common.ExampleUtils

Do resources and runner options setup.

F

FilterExamples - Class in org.apache.beam.examples.cookbook

This is an example that demonstrates several approaches to filtering, and use of the Mean transform.

FilterExamples() - Constructor for class org.apache.beam.examples.cookbook.FilterExamples

FilterTextFn(String) - Constructor for class org.apache.beam.examples.DebuggingWordCount.FilterTextFn

FIVE_MINUTES - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

FormatAsTextFn() - Constructor for class org.apache.beam.examples.WordCount.FormatAsTextFn

G

getBigQueryDataset() - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

getBigQuerySchema() - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

getBigQueryTable() - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

getDefaultOutputCoder() - Method in class org.apache.beam.examples.complete.TfIdf.ReadDocuments

getFilterPattern() - Method in interface org.apache.beam.examples.DebuggingWordCount.WordCountOptions

getInjectorNumWorkers() - Method in interface org.apache.beam.examples.common.ExampleOptions

getInput() - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

getInputFile() - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

getKeepJobsRunning() - Method in interface org.apache.beam.examples.common.ExampleOptions

getOutput() - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

getPubsubSubscription() - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions

getPubsubTopic() - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicOptions

getWindowDuration() - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

getWindowSize() - Method in interface org.apache.beam.examples.WindowedWordCount.Options

I

InsertDelays() - Constructor for class org.apache.beam.examples.cookbook.TriggerExample.InsertDelays

J

JoinExamples - Class in org.apache.beam.examples.cookbook

This example shows how to do a join on two collections.

JoinExamples() - Constructor for class org.apache.beam.examples.cookbook.JoinExamples

L

listInputDocuments(TfIdf.Options) - Static method in class org.apache.beam.examples.complete.TfIdf

Lists documents contained beneath the options.input prefix/directory.

M

main(String[]) - Static method in class org.apache.beam.examples.complete.AutoComplete

main(String[]) - Static method in class org.apache.beam.examples.complete.StreamingWordExtract

Sets up and starts streaming pipeline.

main(String[]) - Static method in class org.apache.beam.examples.complete.TfIdf

main(String[]) - Static method in class org.apache.beam.examples.complete.TopWikipediaSessions

main(String[]) - Static method in class org.apache.beam.examples.complete.TrafficMaxLaneFlow

Sets up and starts streaming pipeline.

main(String[]) - Static method in class org.apache.beam.examples.complete.TrafficRoutes

Sets up and starts streaming pipeline.

main(String[]) - Static method in class org.apache.beam.examples.cookbook.BigQueryTornadoes

main(String[]) - Static method in class org.apache.beam.examples.cookbook.CombinePerKeyExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.DeDupExample

main(String[]) - Static method in class org.apache.beam.examples.cookbook.FilterExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.JoinExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.MaxPerKeyExamples

main(String[]) - Static method in class org.apache.beam.examples.cookbook.TriggerExample

main(String[]) - Static method in class org.apache.beam.examples.DebuggingWordCount

main(String[]) - Static method in class org.apache.beam.examples.MinimalWordCount

main(String[]) - Static method in class org.apache.beam.examples.WindowedWordCount

main(String[]) - Static method in class org.apache.beam.examples.WordCount

MaxFlow() - Constructor for class org.apache.beam.examples.complete.TrafficMaxLaneFlow.MaxFlow

MaxPerKeyExamples - Class in org.apache.beam.examples.cookbook

An example that reads the public samples of weather data from BigQuery, and finds the maximum temperature ('mean_temp') for each month.

MaxPerKeyExamples() - Constructor for class org.apache.beam.examples.cookbook.MaxPerKeyExamples

MinimalWordCount - Class in org.apache.beam.examples

An example that counts words in Shakespeare.

MinimalWordCount() - Constructor for class org.apache.beam.examples.MinimalWordCount

O

ONE_DAY - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

ONE_MINUTE - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

org.apache.beam.examples - package org.apache.beam.examples

org.apache.beam.examples.common - package org.apache.beam.examples.common

org.apache.beam.examples.complete - package org.apache.beam.examples.complete

org.apache.beam.examples.cookbook - package org.apache.beam.examples.cookbook

OutputFactory() - Constructor for class org.apache.beam.examples.WordCount.WordCountOptions.OutputFactory

P

processElement(DoFn<String, String>.ProcessContext) - Method in class org.apache.beam.examples.cookbook.TriggerExample.InsertDelays

processElement(DoFn<KV<String, Long>, KV<String, Long>>.ProcessContext) - Method in class org.apache.beam.examples.DebuggingWordCount.FilterTextFn

PubsubSubscriptionFactory() - Constructor for class org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions.PubsubSubscriptionFactory

PubsubTopicFactory() - Constructor for class org.apache.beam.examples.common.ExamplePubsubTopicOptions.PubsubTopicFactory

R

ReadDocuments(Iterable<URI>) - Constructor for class org.apache.beam.examples.complete.TfIdf.ReadDocuments

S

setBigQueryDataset(String) - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

setBigQuerySchema(TableSchema) - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

setBigQueryTable(String) - Method in interface org.apache.beam.examples.common.ExampleBigQueryTableOptions

setFilterPattern(String) - Method in interface org.apache.beam.examples.DebuggingWordCount.WordCountOptions

setInjectorNumWorkers(int) - Method in interface org.apache.beam.examples.common.ExampleOptions

setInput(String) - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

setInputFile(String) - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

setKeepJobsRunning(boolean) - Method in interface org.apache.beam.examples.common.ExampleOptions

setOutput(String) - Method in interface org.apache.beam.examples.WordCount.WordCountOptions

setPubsubSubscription(String) - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicAndSubscriptionOptions

setPubsubTopic(String) - Method in interface org.apache.beam.examples.common.ExamplePubsubTopicOptions

setup() - Method in class org.apache.beam.examples.common.ExampleUtils

Sets up external resources that are required by the example, such as Pub/Sub topics and BigQuery tables.

setupBigQueryTable() - Method in class org.apache.beam.examples.common.ExampleUtils

Sets up the BigQuery table with the given schema.

setupPubsub() - Method in class org.apache.beam.examples.common.ExampleUtils

Sets up the Google Cloud Pub/Sub topic.

setWindowDuration(Integer) - Method in interface org.apache.beam.examples.cookbook.TriggerExample.TrafficFlowOptions

setWindowSize(Integer) - Method in interface org.apache.beam.examples.WindowedWordCount.Options

StreamingWordExtract - Class in org.apache.beam.examples.complete

A streaming Beam Example using BigQuery output.

StreamingWordExtract() - Constructor for class org.apache.beam.examples.complete.StreamingWordExtract

T

TfIdf - Class in org.apache.beam.examples.complete

An example that computes a basic TF-IDF search table for a directory or GCS prefix.

TfIdf() - Constructor for class org.apache.beam.examples.complete.TfIdf

TfIdf.ComputeTfIdf - Class in org.apache.beam.examples.complete

A transform containing a basic TF-IDF pipeline.

TfIdf.ReadDocuments - Class in org.apache.beam.examples.complete

Reads the documents at the provided uris and returns all lines from the documents tagged with which document they are from.

TfIdf.WriteTfIdf - Class in org.apache.beam.examples.complete

A PTransform to write, in CSV format, a mapping from term and URI to score.

top(int, boolean) - Static method in class org.apache.beam.examples.complete.AutoComplete.ComputeTopCompletions

TopWikipediaSessions - Class in org.apache.beam.examples.complete

An example that reads Wikipedia edit data from Cloud Storage and computes the user with the longest string of edits separated by no more than an hour within each month.

TopWikipediaSessions() - Constructor for class org.apache.beam.examples.complete.TopWikipediaSessions

TrafficMaxLaneFlow - Class in org.apache.beam.examples.complete

A Beam Example that runs in both batch and streaming modes with traffic sensor data.

TrafficMaxLaneFlow() - Constructor for class org.apache.beam.examples.complete.TrafficMaxLaneFlow

TrafficMaxLaneFlow.MaxFlow - Class in org.apache.beam.examples.complete

A custom 'combine function' used with the Combine.perKey transform.

TrafficRoutes - Class in org.apache.beam.examples.complete

A Beam Example that runs in both batch and streaming modes with traffic sensor data.

TrafficRoutes() - Constructor for class org.apache.beam.examples.complete.TrafficRoutes

TriggerExample - Class in org.apache.beam.examples.cookbook

This example illustrates the basic concepts behind triggering.

TriggerExample() - Constructor for class org.apache.beam.examples.cookbook.TriggerExample

TriggerExample.InsertDelays - Class in org.apache.beam.examples.cookbook

Add current time to each record.

TriggerExample.TrafficFlowOptions - Interface in org.apache.beam.examples.cookbook

Inherits standard configuration options.

W

waitToFinish(PipelineResult) - Method in class org.apache.beam.examples.common.ExampleUtils

If DataflowRunner or BlockingDataflowRunner is used, waits for the pipeline to finish and cancels it (and the injector) before the program exists.

WINDOW_DURATION - Static variable in class org.apache.beam.examples.cookbook.TriggerExample

WindowedWordCount - Class in org.apache.beam.examples

An example that counts words in text, and can run over either unbounded or bounded input collections.

WindowedWordCount() - Constructor for class org.apache.beam.examples.WindowedWordCount

WindowedWordCount.Options - Interface in org.apache.beam.examples

Options supported by WindowedWordCount.

WordCount - Class in org.apache.beam.examples

An example that counts words in Shakespeare and includes Beam best practices.

WordCount() - Constructor for class org.apache.beam.examples.WordCount

WordCount.CountWords - Class in org.apache.beam.examples

A PTransform that converts a PCollection containing lines of text into a PCollection of formatted word counts.

WordCount.FormatAsTextFn - Class in org.apache.beam.examples

A SimpleFunction that converts a Word and Count into a printable string.

WordCount.WordCountOptions - Interface in org.apache.beam.examples

Options supported by WordCount.

WordCount.WordCountOptions.OutputFactory - Class in org.apache.beam.examples

Returns "gs://${YOUR_TEMP_DIRECTORY}/counts.txt" as the default destination.

WriteTfIdf(String) - Constructor for class org.apache.beam.examples.complete.TfIdf.WriteTfIdf

A B C D E F G I J L M O P R S T W