| Package | Description |
|---|---|
| org.apache.apex.malhar.stream.api | |
| org.apache.apex.malhar.stream.api.impl |
| Modifier and Type | Class and Description |
|---|---|
static class |
Option.AttributeSetting<T>
An option used to set the
Attribute |
static class |
Option.OpName
An option used to set the name of the operator
|
static class |
Option.PropSetting
An option used to set the property value of the operator
|
| Modifier and Type | Method and Description |
|---|---|
static <T> Option |
Option.Options.attr(com.datatorrent.api.Attribute<T> attr,
T obj) |
static Option |
Option.Options.name(String name) |
static Option |
Option.Options.prop(String name,
Object value) |
| Modifier and Type | Method and Description |
|---|---|
<O,ACCU,STREAM extends WindowedStream<Tuple.WindowedTuple<O>>> |
WindowedStream.accumulate(Accumulation<T,ACCU,O> accumulation,
Option... opts)
Add
WindowedOperatorImpl with specified Accumulation Accumulate tuples by some key within the window definition in this stream Also give a name to the accumulation |
<K,V,O,ACCU,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,O>>>> |
WindowedStream.accumulateByKey(Accumulation<V,ACCU,O> accumulation,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts)
Add
KeyedWindowedOperatorImpl with specified Accumulation Accumulate tuples by some key within the window definition in this stream Also give a name to the accumulation |
<O,STREAM extends ApexStream<O>> |
ApexStream.addOperator(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort,
Option... opts)
Extend the dag by adding one operator
|
<STREAM extends WindowedStream<Tuple.WindowedTuple<Long>>> |
WindowedStream.count(Option... opts)
Count of all tuples
|
<K,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,Long>>>> |
WindowedStream.countByKey(Function.ToKeyValue<T,K,Long> convertToKeyValue,
Option... opts)
Count tuples by the key
|
<O,STREAM extends ApexStream<O>> |
ApexStream.endWith(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
Option... opts)
Extend the dag by adding one end operator
|
<STREAM extends ApexStream<T>> |
ApexStream.filter(Function.FilterFunction<T> filter,
Option... opts)
Filter transformation
Add an operator to the DAG which filter out tuple T that cannot satisfy the FilterFunction |
<O,STREAM extends ApexStream<O>> |
ApexStream.flatMap(Function.FlatMapFunction<T,O> flatten,
Option... opts)
Flat map transformation
Add an operator to the DAG which convert tuple T to a collection of tuple O
|
<O,STREAM extends WindowedStream<Tuple.WindowedTuple<O>>> |
WindowedStream.fold(FoldFn<T,O> fold,
Option... opts)
|
<K,V,O,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,O>>>> |
WindowedStream.foldByKey(FoldFn<V,O> fold,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts)
|
<O,K,STREAM extends WindowedStream<KeyValPair<K,Iterable<O>>>> |
WindowedStream.groupByKey(Function.ToKeyValue<T,K,O> convertToKeyVal,
Option... opts)
Return tuples for each key for each window
|
<O,STREAM extends ApexStream<O>> |
ApexStream.map(Function.MapFunction<T,O> mapFunction,
Option... opts)
Simple map transformation
Add an operator to the DAG which convert tuple T to tuple O |
<STREAM extends ApexStream<T>> |
ApexStream.print(Option... opts)
Add a stdout console output operator
|
<STREAM extends WindowedStream<Tuple.WindowedTuple<T>>> |
WindowedStream.reduce(ReduceFn<T> reduce,
Option... opts)
|
<K,V,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,V>>>> |
WindowedStream.reduceByKey(ReduceFn<V> reduce,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts)
Add
KeyedWindowedOperatorImpl with specified ReduceFn Reduce transformation by selected key Add an operator to the DAG which merge tuple t1, t2 to new tuple by key |
<STREAM extends WindowedStream<Tuple.WindowedTuple<List<T>>>> |
WindowedStream.top(int N,
Option... opts)
Return top N tuples of all tuples in the window
|
<K,V,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,List<V>>>>> |
WindowedStream.topByKey(int N,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts)
Return top N tuples by the selected key
|
| Modifier and Type | Method and Description |
|---|---|
<O,ACCU,STREAM extends WindowedStream<Tuple.WindowedTuple<O>>> |
ApexWindowedStreamImpl.accumulate(Accumulation<T,ACCU,O> accumulation,
Option... opts) |
<K,V,O,ACCU,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,O>>>> |
ApexWindowedStreamImpl.accumulateByKey(Accumulation<V,ACCU,O> accumulation,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts) |
DagMeta.NodeMeta |
DagMeta.addNode(com.datatorrent.api.Operator operator,
DagMeta.NodeMeta parent,
com.datatorrent.api.Operator.OutputPort parentOutput,
com.datatorrent.api.Operator.InputPort inputPort,
Option... options) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.addOperator(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
com.datatorrent.api.Operator.OutputPort<O> outputPort,
Option... opts) |
<STREAM extends WindowedStream<Tuple.WindowedTuple<Long>>> |
ApexWindowedStreamImpl.count(Option... opts) |
<K,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,Long>>>> |
ApexWindowedStreamImpl.countByKey(Function.ToKeyValue<T,K,Long> convertToKeyValue,
Option... opts) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.endWith(com.datatorrent.api.Operator op,
com.datatorrent.api.Operator.InputPort<T> inputPort,
Option... opts) |
<STREAM extends ApexStream<T>> |
ApexStreamImpl.filter(Function.FilterFunction<T> filter,
Option... opts) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.flatMap(Function.FlatMapFunction<T,O> flatten,
Option... opts) |
<O,STREAM extends WindowedStream<Tuple.WindowedTuple<O>>> |
ApexWindowedStreamImpl.fold(FoldFn<T,O> fold,
Option... opts) |
<K,V,O,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,O>>>> |
ApexWindowedStreamImpl.foldByKey(FoldFn<V,O> fold,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts) |
static ApexStream<String> |
StreamFactory.fromFolder(String folderName,
Option... opts)
Create a stream of string tuples from reading files in hdfs folder line by line
|
static <T> ApexStream<T> |
StreamFactory.fromInput(com.datatorrent.api.InputOperator operator,
com.datatorrent.api.Operator.OutputPort<T> outputPort,
Option... opts)
Create a stream with any input operator
|
static ApexStream<String> |
StreamFactory.fromKafka08(String zookeepers,
String topic,
Option... opts)
Create a stream of string reading input from kafka 0.8
|
static ApexStream<byte[]> |
StreamFactory.fromKafka09(String brokers,
String topic,
Option... opts)
Create stream of byte array messages from kafka 0.9
|
static ApexStream<byte[]> |
StreamFactory.fromKafka09(String brokers,
String topic,
PartitionStrategy strategy,
int partitionNumber,
Option... opts)
Create stream of byte array messages from kafka 0.9 with more partition options
|
<O,K,STREAM extends WindowedStream<KeyValPair<K,Iterable<O>>>> |
ApexWindowedStreamImpl.groupByKey(Function.ToKeyValue<T,K,O> convertToKeyVal,
Option... opts) |
<O,STREAM extends ApexStream<O>> |
ApexStreamImpl.map(Function.MapFunction<T,O> mf,
Option... opts) |
ApexStreamImpl<T> |
ApexStreamImpl.print(Option... opts) |
<STREAM extends WindowedStream<Tuple.WindowedTuple<T>>> |
ApexWindowedStreamImpl.reduce(ReduceFn<T> reduce,
Option... opts) |
<K,V,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,V>>>> |
ApexWindowedStreamImpl.reduceByKey(ReduceFn<V> reduce,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts) |
<STREAM extends WindowedStream<Tuple.WindowedTuple<List<T>>>> |
ApexWindowedStreamImpl.top(int N,
Option... opts) |
<K,V,STREAM extends WindowedStream<Tuple.WindowedTuple<KeyValPair<K,List<V>>>>> |
ApexWindowedStreamImpl.topByKey(int N,
Function.ToKeyValue<T,K,V> convertToKeyVal,
Option... opts) |
| Constructor and Description |
|---|
DagMeta.NodeMeta(com.datatorrent.api.Operator operator,
Option... options) |
Copyright © 2015-2017 Apache Software Foundation. All Rights Reserved.