| Package | Description |
|---|---|
| org.apache.apex.malhar.stream.api | |
| org.apache.apex.malhar.stream.api.impl |
| Modifier and Type | Interface and Description |
|---|---|
interface |
WindowedStream<T>
A stream with windowed transformation
|
| Modifier and Type | Method and Description |
|---|---|
<O,STREAM extends ApexStream<O>> |
ApexStream.addOperator(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort)
Extend the dag by adding one operator
|
<O,STREAM extends ApexStream<O>> |
ApexStream.addOperator(String opName,
com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort)
Extend the dag by adding one
Operator |
<STREAM extends ApexStream<Integer>> |
ApexStream.count()
Count of all tuples
|
<STREAM extends ApexStream<Map<Object,Integer>>> |
ApexStream.countByKey()
Count tuples by the key
If the input is KeyedTuple it will get the key from getKey method from the tuple If not, use the tuple itself as a key |
<STREAM extends ApexStream<Map<Object,Integer>>> |
ApexStream.countByKey(int key)
Count tuples by the indexed key
|
<STREAM extends ApexStream<T>> |
ApexStream.filter(Function.FilterFunction<T> filter)
Filter transformation
Add an operator to the DAG which filter out tuple T that cannot satisfy the FilterFunction |
<STREAM extends ApexStream<T>> |
ApexStream.filter(String name,
Function.FilterFunction<T> filter)
Filter transformation
Add an operator to the DAG which filter out tuple T that cannot satisfy the FilterFunction |
<O,STREAM extends ApexStream<O>> |
ApexStream.flatMap(Function.FlatMapFunction<T,O> flatten)
Flat map transformation
Add an operator to the DAG which convert tuple T to a collection of tuple O
|
<O,STREAM extends ApexStream<O>> |
ApexStream.flatMap(String name,
Function.FlatMapFunction<T,O> flatten)
Flat map transformation
Add an operator to the DAG which convert tuple T to a collection of tuple O |
<O,STREAM extends ApexStream<O>> |
ApexStream.fold(O initialValue,
Function.FoldFunction<T,O> fold)
Fold transformation
Add an operator to the DAG which merge tuple T to accumulated result tuple O |
<O,STREAM extends ApexStream<O>> |
ApexStream.fold(String name,
O initialValue,
Function.FoldFunction<T,O> fold)
Fold transformation
Add an operator to the DAG which merge tuple T to accumulated result tuple O |
<O,STREAM extends ApexStream<O>> |
ApexStream.map(Function.MapFunction<T,O> mapFunction)
Simple map transformation
Add an operator to the DAG which convert tuple T to tuple O |
<O,STREAM extends ApexStream<O>> |
ApexStream.map(String name,
Function.MapFunction<T,O> mapFunction)
Simple map transformation
Add an operator to the DAG which convert tuple T to tuple O |
<STREAM extends ApexStream<T>> |
ApexStream.print()
Add a stdout console output operator
|
<STREAM extends ApexStream<T>> |
ApexStream.printErr()
Add a stderr console output operator
|
<STREAM extends ApexStream<T>> |
ApexStream.reduce(Function.ReduceFunction<T> reduce)
Reduce transformation
Add an operator to the DAG which merge tuple t1, t2 to new tuple |
<STREAM extends ApexStream<T>> |
ApexStream.reduce(String name,
Function.ReduceFunction<T> reduce)
Reduce transformation
Add an operator to the DAG which merge tuple t1, t2 to new tuple |
<STREAM extends ApexStream<T>> |
ApexStream.setGlobalAttribute(com.datatorrent.api.Attribute attribute,
Object value)
Set attributes at the DAG level
|
<STREAM extends ApexStream<T>> |
ApexStream.union(ApexStream<T>... others)
Union multiple stream into one
|
<STREAM extends ApexStream<T>> |
ApexStream.with(com.datatorrent.api.Attribute attribute,
Object value)
Set the attribute value
If it is DAG attribute, it will be applied to the whole DAG If it is Operator attribute, it will be applied to last connected operatorIf it is InputPort attribute, it will be applied to the input port of the last connected streamIf it is OutputPort attribute, it will be applied to the output port of the last connected streamIf it is both InputPort&OutputPort attribute, it will be applied to last connected stream |
<STREAM extends ApexStream<T>> |
ApexStream.with(com.datatorrent.api.DAG.Locality locality)
Set the locality
|
<STREAM extends ApexStream<T>> |
ApexStream.with(String propName,
Object value)
Set the property value of the last connected operator
|
| Modifier and Type | Method and Description |
|---|---|
<STREAM extends ApexStream<T>> |
ApexStream.union(ApexStream<T>... others)
Union multiple stream into one
|
| Modifier and Type | Class and Description |
|---|---|
class |
ApexStreamImpl<T>
Default stream implementation for ApexStream interface.
|
| Modifier and Type | Method and Description |
|---|---|
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.addOperator(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.addOperator(String opName,
com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort) |
<STREAM extends ApexStream<Integer>> |
ApexStreamImpl.count() |
<STREAM extends ApexStream<Map<Object,Integer>>> |
ApexStreamImpl.countByKey() |
<STREAM extends ApexStream<Map<Object,Integer>>> |
ApexStreamImpl.countByKey(int key) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.filter(Function.FilterFunction<T> filter) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.filter(String name,
Function.FilterFunction<T> filter) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.flatMap(Function.FlatMapFunction<T,O> flatten) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.flatMap(String name,
Function.FlatMapFunction<T,O> flatten) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.fold(O initialValue,
Function.FoldFunction<T,O> fold) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.fold(String name,
O initialValue,
Function.FoldFunction<T,O> fold) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.map(Function.MapFunction<T,O> mf) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.map(String name,
Function.MapFunction<T,O> mf) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.reduce(Function.ReduceFunction<T> reduce) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.reduce(String name,
Function.ReduceFunction<T> reduce) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.union(ApexStream<T>... others) |
| Modifier and Type | Method and Description |
|---|---|
static ApexStream<String> |
StreamFactory.fromFolder(String folderName) |
static ApexStream<String> |
StreamFactory.fromFolder(String inputOperatorName,
String folderName) |
static <T> ApexStream<T> |
StreamFactory.fromInput(com.datatorrent.api.InputOperator operator,
com.datatorrent.api.Operator.OutputPort<T> outputPort) |
static <T> ApexStream<T> |
StreamFactory.fromInput(String inputOperatorName,
com.datatorrent.api.InputOperator operator,
com.datatorrent.api.Operator.OutputPort<T> outputPort) |
static ApexStream<String> |
StreamFactory.fromKafka08(String zookeepers,
String topic) |
static ApexStream<String> |
StreamFactory.fromKafka08(String inputName,
String zookeepers,
String topic) |
static ApexStream<String> |
StreamFactory.fromKafka09(String brokers,
String topic) |
static ApexStream<String> |
StreamFactory.fromKafka09(String name,
String brokers,
String topic) |
ApexStream<T> |
ApexStreamImpl.printErr() |
ApexStream<T> |
ApexStreamImpl.setGlobalAttribute(com.datatorrent.api.Attribute attribute,
Object value) |
ApexStream<T> |
ApexStreamImpl.with(com.datatorrent.api.Attribute attribute,
Object value) |
ApexStream<T> |
ApexStreamImpl.with(com.datatorrent.api.DAG.Locality locality) |
ApexStream<T> |
ApexStreamImpl.with(String propName,
Object value) |
| Modifier and Type | Method and Description |
|---|---|
<STREAM extends ApexStream<T>> |
ApexStreamImpl.union(ApexStream<T>... others) |
| Constructor and Description |
|---|
ApexStreamImpl(ApexStream<T> apexStream) |
Copyright © 2015-2016 Apache Software Foundation. All Rights Reserved.