org.apache.apex.malhar.stream.api.impl

Class StreamFactory

java.lang.Object

org.apache.apex.malhar.stream.api.impl.StreamFactory

@InterfaceStability.Evolving
public class StreamFactory
extends Object

A Factory class to build stream from different input sources

Since:

3.4.0

Constructor Summary

Constructors

Constructor and Description
StreamFactory()

Method Summary

Methods

Modifier and Type	Method and Description
static ApexStream<String>	fromFolder(String folderName)
static ApexStream<String>	fromFolder(String folderName, Option... opts) Create a stream of string tuples from reading files in hdfs folder line by line
static <T> ApexStream<T>	fromInput(com.datatorrent.api.InputOperator operator, com.datatorrent.api.Operator.OutputPort<T> outputPort, Option... opts) Create a stream with any input operator
static ApexStream<String>	fromKafka08(String zookeepers, String topic)
static ApexStream<String>	fromKafka08(String zookeepers, String topic, Option... opts) Create a stream of string reading input from kafka 0.8
static ApexStream<byte[]>	fromKafka09(String brokers, String topic, Option... opts) Create stream of byte array messages from kafka 0.9
static ApexStream<byte[]>	fromKafka09(String brokers, String topic, PartitionStrategy strategy, int partitionNumber, Option... opts) Create stream of byte array messages from kafka 0.9 with more partition options

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamFactory

public StreamFactory()

Method Detail

fromFolder

public static ApexStream<String> fromFolder(String folderName,
                            Option... opts)

Create a stream of string tuples from reading files in hdfs folder line by line

Parameters:

folderName -

opts -

Returns:

fromFolder

public static ApexStream<String> fromFolder(String folderName)

fromKafka08

public static ApexStream<String> fromKafka08(String zookeepers,
                             String topic)

fromKafka08

public static ApexStream<String> fromKafka08(String zookeepers,
                             String topic,
                             Option... opts)

Create a stream of string reading input from kafka 0.8

Parameters:

zookeepers -

topic -

opts -

Returns:

fromInput

public static <T> ApexStream<T> fromInput(com.datatorrent.api.InputOperator operator,
                          com.datatorrent.api.Operator.OutputPort<T> outputPort,
                          Option... opts)

Create a stream with any input operator

Type Parameters:

T -

Parameters:

operator -

outputPort -

opts -

Returns:

fromKafka09

public static ApexStream<byte[]> fromKafka09(String brokers,
                             String topic,
                             Option... opts)

Create stream of byte array messages from kafka 0.9

Parameters:

brokers -

topic -

opts -

Returns:

fromKafka09

public static ApexStream<byte[]> fromKafka09(String brokers,
                             String topic,
                             PartitionStrategy strategy,
                             int partitionNumber,
                             Option... opts)

Create stream of byte array messages from kafka 0.9 with more partition options