| Package | Description |
|---|---|
| org.apache.apex.malhar.stream.api | |
| org.apache.apex.malhar.stream.api.impl |
| Modifier and Type | Class and Description |
|---|---|
class |
CompositeStreamTransform<INSTREAM extends ApexStream,OUTSTREAM extends ApexStream>
A group of Streams and transforms in between
|
class |
CompositeStreamTransform<INSTREAM extends ApexStream,OUTSTREAM extends ApexStream>
A group of Streams and transforms in between
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
WindowedStream<T>
A stream with windowed transformation
|
| Modifier and Type | Method and Description |
|---|---|
<O,INSTREAM extends ApexStream<T>,OUTSTREAM extends ApexStream<O>> |
ApexStream.addCompositeStreams(CompositeStreamTransform<INSTREAM,OUTSTREAM> compositeStreamTransform)
Extend the dag by adding one
CompositeStreamTransform |
<O,INSTREAM extends ApexStream<T>,OUTSTREAM extends ApexStream<O>> |
ApexStream.addCompositeStreams(CompositeStreamTransform<INSTREAM,OUTSTREAM> compositeStreamTransform)
Extend the dag by adding one
CompositeStreamTransform |
<O,STREAM extends ApexStream<O>> |
ApexStream.addOperator(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort,
Option... opts)
Extend the dag by adding one operator
|
<O,STREAM extends ApexStream<O>> |
ApexStream.endWith(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
Option... opts)
Extend the dag by adding one end operator
|
<STREAM extends ApexStream<T>> |
ApexStream.filter(Function.FilterFunction<T> filter,
Option... opts)
Filter transformation
Add an operator to the DAG which filter out tuple T that cannot satisfy the FilterFunction |
<O,STREAM extends ApexStream<O>> |
ApexStream.flatMap(Function.FlatMapFunction<T,O> flatten,
Option... opts)
Flat map transformation
Add an operator to the DAG which convert tuple T to a collection of tuple O
|
<O,STREAM extends ApexStream<O>> |
ApexStream.map(Function.MapFunction<T,O> mapFunction,
Option... opts)
Simple map transformation
Add an operator to the DAG which convert tuple T to tuple O |
<STREAM extends ApexStream<T>> |
ApexStream.print()
Add a stdout console output operator
|
<STREAM extends ApexStream<T>> |
ApexStream.print(Option... opts)
Add a stdout console output operator
|
<STREAM extends ApexStream<T>> |
ApexStream.printErr()
Add a stderr console output operator
|
<STREAM extends ApexStream<T>> |
ApexStream.setGlobalAttribute(com.datatorrent.api.Attribute attribute,
Object value)
Set attributes at the DAG level
|
<STREAM extends ApexStream<T>> |
ApexStream.union(ApexStream<T>... others)
Union multiple stream into one
|
<STREAM extends ApexStream<T>> |
ApexStream.with(com.datatorrent.api.Attribute attribute,
Object value)
Set the attribute value
If it is DAG attribute, it will be applied to the whole DAG If it is Operator attribute, it will be applied to last connected operatorIf it is InputPort attribute, it will be applied to the input port of the last connected streamIf it is OutputPort attribute, it will be applied to the output port of the last connected streamIf it is both InputPort&OutputPort attribute, it will be applied to last connected stream |
<STREAM extends ApexStream<T>> |
ApexStream.with(com.datatorrent.api.DAG.Locality locality)
Set the locality
|
<STREAM extends ApexStream<T>> |
ApexStream.with(String propName,
Object value)
Set the property value of the last connected operator
|
| Modifier and Type | Method and Description |
|---|---|
<STREAM extends ApexStream<T>> |
ApexStream.union(ApexStream<T>... others)
Union multiple stream into one
|
| Modifier and Type | Class and Description |
|---|---|
class |
ApexStreamImpl<T>
Default stream implementation for ApexStream interface.
|
class |
ApexWindowedStreamImpl<T>
Default windowed stream implementation for WindowedStream interface.
|
| Modifier and Type | Method and Description |
|---|---|
<O,INSTREAM extends ApexStream<T>,OUTSTREAM extends ApexStream<O>> |
ApexStreamImpl.addCompositeStreams(CompositeStreamTransform<INSTREAM,OUTSTREAM> compositeStreamTransform) |
<O,INSTREAM extends ApexStream<T>,OUTSTREAM extends ApexStream<O>> |
ApexStreamImpl.addCompositeStreams(CompositeStreamTransform<INSTREAM,OUTSTREAM> compositeStreamTransform) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.addOperator(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort,
Option... opts) |
<STREAM extends ApexStream<Map.Entry<Object,Integer>>> |
ApexStreamImpl.countByElement() |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.endWith(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
Option... opts) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.filter(Function.FilterFunction<T> filter,
Option... opts) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.flatMap(Function.FlatMapFunction<T,O> flatten,
Option... opts) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.map(Function.MapFunction<T,O> mf,
Option... opts) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.union(ApexStream<T>... others) |
| Modifier and Type | Method and Description |
|---|---|
static ApexStream<String> |
StreamFactory.fromFolder(String folderName) |
static ApexStream<String> |
StreamFactory.fromFolder(String folderName,
Option... opts)
Create a stream of string tuples from reading files in hdfs folder line by line
|
static <T> ApexStream<T> |
StreamFactory.fromInput(com.datatorrent.api.InputOperator operator,
com.datatorrent.api.Operator.OutputPort<T> outputPort,
Option... opts)
Create a stream with any input operator
|
static ApexStream<String> |
StreamFactory.fromKafka08(String zookeepers,
String topic) |
static ApexStream<String> |
StreamFactory.fromKafka08(String zookeepers,
String topic,
Option... opts)
Create a stream of string reading input from kafka 0.8
|
static ApexStream<byte[]> |
StreamFactory.fromKafka09(String brokers,
String topic,
Option... opts)
Create stream of byte array messages from kafka 0.9
|
static ApexStream<byte[]> |
StreamFactory.fromKafka09(String brokers,
String topic,
PartitionStrategy strategy,
int partitionNumber,
Option... opts)
Create stream of byte array messages from kafka 0.9 with more partition options
|
protected <O> ApexStream<O> |
ApexStreamImpl.newStream(DagMeta graph,
ApexStreamImpl.Brick<O> newBrick) |
protected <O> ApexStream<O> |
ApexWindowedStreamImpl.newStream(DagMeta graph,
ApexStreamImpl.Brick<O> newBrick) |
ApexStream<T> |
ApexStreamImpl.printErr() |
ApexStream<T> |
ApexStreamImpl.setGlobalAttribute(com.datatorrent.api.Attribute attribute,
Object value) |
ApexStream<T> |
ApexStreamImpl.with(com.datatorrent.api.Attribute attribute,
Object value) |
ApexStream<T> |
ApexStreamImpl.with(com.datatorrent.api.DAG.Locality locality) |
ApexStream<T> |
ApexStreamImpl.with(String propName,
Object value) |
| Modifier and Type | Method and Description |
|---|---|
<STREAM extends ApexStream<T>> |
ApexStreamImpl.union(ApexStream<T>... others) |
Copyright © 2015-2017 Apache Software Foundation. All Rights Reserved.