A B C D E F G H I L N O P R S T U V W Z

A

AbstractFlumeInputOperator<T> - Class in org.apache.apex.malhar.flume.operator

Abstract AbstractFlumeInputOperator class.

AbstractFlumeInputOperator() - Constructor for class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

AbstractFlumeInputOperator.ConnectionStatus - Class in org.apache.apex.malhar.flume.operator

AbstractFlumeInputOperator.ConnectionStatus() - Constructor for class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ConnectionStatus

AbstractFlumeInputOperator.ZKStatsListner - Class in org.apache.apex.malhar.flume.operator

AbstractFlumeInputOperator.ZKStatsListner() - Constructor for class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ZKStatsListner

activate(Context.OperatorContext) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

advertise(Discovery.Service<T>) - Method in interface org.apache.apex.malhar.flume.discovery.Discovery

Advertise the host/port address where FlumeSink is accepting a client connection.

advertise(Discovery.Service<byte[]>) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

B

BASE_DIR_KEY - Static variable in class org.apache.apex.malhar.flume.storage.HDFSStorage

beginWindow(long) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

BLOCK_SIZE_MULTIPLE - Static variable in class org.apache.apex.malhar.flume.storage.HDFSStorage

BLOCKSIZE - Static variable in class org.apache.apex.malhar.flume.storage.HDFSStorage

build() - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor.Builder

build() - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Builder

C

checkpointed(long) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

clean(byte[]) - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

clean(byte[]) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

clean(byte[]) - Method in interface org.apache.apex.malhar.flume.storage.Storage

This is used to clean up the files identified by identifier

client - Variable in class org.apache.apex.malhar.flume.sink.Server.Request

close() - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor

close() - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor

ColumnFilteringFormattingInterceptor - Class in org.apache.apex.malhar.flume.interceptor

ColumnFilteringFormattingInterceptor class.

ColumnFilteringFormattingInterceptor.Builder - Class in org.apache.apex.malhar.flume.interceptor

ColumnFilteringFormattingInterceptor.Builder() - Constructor for class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor.Builder

ColumnFilteringFormattingInterceptor.Constants - Class in org.apache.apex.malhar.flume.interceptor

ColumnFilteringFormattingInterceptor.Constants() - Constructor for class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor.Constants

ColumnFilteringInterceptor - Class in org.apache.apex.malhar.flume.interceptor

ColumnFilteringInterceptor class.

ColumnFilteringInterceptor.Builder - Class in org.apache.apex.malhar.flume.interceptor

ColumnFilteringInterceptor.Builder() - Constructor for class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Builder

ColumnFilteringInterceptor.Constants - Class in org.apache.apex.malhar.flume.interceptor

ColumnFilteringInterceptor.Constants() - Constructor for class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Constants

COLUMNS - Static variable in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Constants

COLUMNS_FORMATTER - Static variable in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor.Constants

committed(long) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

configure(Context) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

configure(Context) - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor.Builder

configure(Context) - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Builder

configure(Context) - Method in class org.apache.apex.malhar.flume.sink.FlumeSink

configure(Context) - Method in class org.apache.apex.malhar.flume.source.HdfsTestSource

configure(Context) - Method in class org.apache.apex.malhar.flume.source.TestSource

configure(Context) - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

configure(Context) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

This stores the Identifier information identified in the last store function call

convert(Event) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

D

deactivate() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

DebugWrapper - Class in org.apache.apex.malhar.flume.storage

DebugWrapper class.

DebugWrapper() - Constructor for class org.apache.apex.malhar.flume.storage.DebugWrapper

DEFAULT_BLOCK_SIZE - Static variable in class org.apache.apex.malhar.flume.storage.HDFSStorage

definePartitions(Collection<Partitioner.Partition<AbstractFlumeInputOperator<T>>>, Partitioner.PartitioningContext) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

disconnected() - Method in class org.apache.apex.malhar.flume.sink.Server.Client

discover() - Method in interface org.apache.apex.malhar.flume.discovery.Discovery

Discover all the addresses which are actively accepting the client connections.

discover() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

discoveredFlumeSinks - Static variable in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

Discovery<T> - Interface in org.apache.apex.malhar.flume.discovery

When FlumeSink server instance binds to the network interface, it can publish its whereabouts by invoking advertise method on the Discovery object.

Discovery.Service<T> - Interface in org.apache.apex.malhar.flume.discovery

doAdvertise(Discovery.Service<byte[]>, boolean) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

drop - Variable in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

DST_SEPARATOR - Static variable in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Constants

DST_SEPARATOR_DFLT - Static variable in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Constants

E

emitTimer - Variable in class org.apache.apex.malhar.flume.source.HdfsTestSource

emitTimer - Variable in class org.apache.apex.malhar.flume.source.TestSource

emitTuples() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

endWindow() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

equals(Object) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

equals(Object) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ConnectionStatus

equals(Object) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

ErrorMaskingEventCodec - Class in org.apache.apex.malhar.flume.storage

ErrorMaskingEventCodec class.

ErrorMaskingEventCodec() - Constructor for class org.apache.apex.malhar.flume.storage.ErrorMaskingEventCodec

EventCodec - Class in org.apache.apex.malhar.flume.storage

EventCodec class.

EventCodec() - Constructor for class org.apache.apex.malhar.flume.storage.EventCodec

F

FIXED_SIZE - Static variable in class org.apache.apex.malhar.flume.sink.Server.Request

FlumeSink - Class in org.apache.apex.malhar.flume.sink

FlumeSink is a flume sink developed to ingest the data into DataTorrent DAG from flume.

FlumeSink() - Constructor for class org.apache.apex.malhar.flume.sink.FlumeSink

flush() - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

flush() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

flush() - Method in interface org.apache.apex.malhar.flume.storage.Storage

This flushes the data from stream

fromByteArray(Slice) - Method in class org.apache.apex.malhar.flume.storage.ErrorMaskingEventCodec

fromByteArray(Slice) - Method in class org.apache.apex.malhar.flume.storage.EventCodec

fs - Variable in class org.apache.apex.malhar.flume.source.HdfsTestSource

G

getAcceptedTolerance() - Method in class org.apache.apex.malhar.flume.sink.FlumeSink

getAddress() - Method in class org.apache.apex.malhar.flume.sink.Server.Request

getBaseDir() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

getBasePath() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

getBlockSize() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

getBlockSizeMultiple() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

getClientConnection(SocketChannel, ServerSocketChannel) - Method in class org.apache.apex.malhar.flume.sink.Server

getCodec() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

getCommand(byte) - Static method in enum org.apache.apex.malhar.flume.sink.Server.Command

getConnectAddresses() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

getConnectionRetryCount() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

getConnectionString() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

getConnectionTimeoutMillis() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

getConntectionRetrySleepMillis() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

getEventCount() - Method in class org.apache.apex.malhar.flume.sink.Server.Request

getHost() - Method in interface org.apache.apex.malhar.flume.discovery.Discovery.Service

getId() - Method in interface org.apache.apex.malhar.flume.discovery.Discovery.Service

getId() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

getIdleCount() - Method in class org.apache.apex.malhar.flume.sink.Server.Request

getInstanceSerializer(TypeReference<ServiceInstance<T>>) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery.InstanceSerializerFactory

getIntervalMillis() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ZKStatsListner

getMaxEventsPerSecond() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

getOrdinal() - Method in enum org.apache.apex.malhar.flume.sink.Server.Command

getPartition(Event) - Method in class org.apache.apex.malhar.flume.storage.EventCodec

getPayload() - Method in interface org.apache.apex.malhar.flume.discovery.Discovery.Service

getPort() - Method in interface org.apache.apex.malhar.flume.discovery.Discovery.Service

getRequest(byte[], int, Server.Client) - Static method in class org.apache.apex.malhar.flume.sink.Server.Request

getServiceName() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

H

handleException(Exception, EventLoop) - Method in class org.apache.apex.malhar.flume.sink.Server

handleIdleTime() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

hashCode() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

hashCode() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ConnectionStatus

hashCode() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

HDFSStorage - Class in org.apache.apex.malhar.flume.storage

HDFSStorage is developed to store and retrieve the data from HDFS

The properties that can be set on HDFSStorage are:
baseDir - The base directory where the data is going to be stored
restore - This is used to restore the application from previous failure
blockSize - The maximum size of the each file to created.

HDFSStorage() - Constructor for class org.apache.apex.malhar.flume.storage.HDFSStorage

HdfsTestSource - Class in org.apache.apex.malhar.flume.source

TestSource class.

HdfsTestSource() - Constructor for class org.apache.apex.malhar.flume.source.HdfsTestSource

I

ID - Static variable in interface org.apache.apex.malhar.flume.storage.Storage

key in the context for Unique identifier for the storage which may be used to recover from failure.

INIT_DATE - Static variable in class org.apache.apex.malhar.flume.source.HdfsTestSource

initialize() - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor

initialize() - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor

intercept(Event) - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor

intercept(List<Event>) - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringFormattingInterceptor

intercept(Event) - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor

intercept(List<Event>) - Method in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor

isRestore() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

L

LINE_NUMBER - Static variable in class org.apache.apex.malhar.flume.source.TestSource

N

NUMBER_RETRY - Static variable in class org.apache.apex.malhar.flume.storage.HDFSStorage

O

onMessage(byte[], int, int) - Method in class org.apache.apex.malhar.flume.sink.Server.Client

org.apache.apex.malhar.flume.discovery - package org.apache.apex.malhar.flume.discovery

org.apache.apex.malhar.flume.interceptor - package org.apache.apex.malhar.flume.interceptor

org.apache.apex.malhar.flume.operator - package org.apache.apex.malhar.flume.operator

org.apache.apex.malhar.flume.sink - package org.apache.apex.malhar.flume.sink

org.apache.apex.malhar.flume.source - package org.apache.apex.malhar.flume.source

org.apache.apex.malhar.flume.storage - package org.apache.apex.malhar.flume.storage

output - Variable in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

P

partitioned(Map<Integer, Partitioner.Partition<AbstractFlumeInputOperator<T>>>) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

PERCENT_PAST_EVENTS - Static variable in class org.apache.apex.malhar.flume.source.TestSource

process() - Method in class org.apache.apex.malhar.flume.sink.FlumeSink

processStats(StatsListener.BatchedOperatorStats) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ZKStatsListner

R

RATE - Static variable in class org.apache.apex.malhar.flume.source.HdfsTestSource

RATE - Static variable in class org.apache.apex.malhar.flume.source.TestSource

readInt(byte[], int) - Static method in class org.apache.apex.malhar.flume.sink.Server

readLong(byte[], int) - Static method in class org.apache.apex.malhar.flume.sink.Server

registered(SelectionKey) - Method in class org.apache.apex.malhar.flume.sink.Server

requests - Variable in class org.apache.apex.malhar.flume.sink.Server

RESTORE_KEY - Static variable in class org.apache.apex.malhar.flume.storage.HDFSStorage

retrieve(byte[]) - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

retrieve(byte[]) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

retrieve(byte[]) - Method in interface org.apache.apex.malhar.flume.storage.Storage

This returns the data bytes for the current identifier and the identifier for next data bytes.

retrieveNext() - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

retrieveNext() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

retrieveNext() - Method in interface org.apache.apex.malhar.flume.storage.Storage

This returns data bytes and the identifier for the next data bytes.

S

Server - Class in org.apache.apex.malhar.flume.sink

Server class.

Server(String, Discovery<byte[]>, long) - Constructor for class org.apache.apex.malhar.flume.sink.Server

Server.Client - Class in org.apache.apex.malhar.flume.sink

Server.Client() - Constructor for class org.apache.apex.malhar.flume.sink.Server.Client

Server.Command - Enum in org.apache.apex.malhar.flume.sink

Server.Request - Class in org.apache.apex.malhar.flume.sink

Server.Request(Server.Command, Server.Client) - Constructor for class org.apache.apex.malhar.flume.sink.Server.Request

setAcceptedTolerance(long) - Method in class org.apache.apex.malhar.flume.sink.FlumeSink

setBaseDir(String) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

setBasePath(String) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setBlockSize(long) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

setBlockSizeMultiple(int) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

setCodec(StreamCodec<Event>) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

setConnectAddresses(String[]) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

setConnectionRetryCount(int) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setConnectionString(String) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setConnectionTimeoutMillis(int) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setConntectionRetrySleepMillis(int) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setId(String) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

setIntervalMillis(long) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ZKStatsListner

setMaxEventsPerSecond(long) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

setRestore(boolean) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

setServiceName(String) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setup(Context) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

setup(Context.OperatorContext) - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

setup(Context) - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

setup(Context) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

SOURCE_DIR - Static variable in class org.apache.apex.malhar.flume.source.HdfsTestSource

SOURCE_FILE - Static variable in class org.apache.apex.malhar.flume.source.TestSource

SRC_SEPARATOR - Static variable in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Constants

SRC_SEPARATOR_DFLT - Static variable in class org.apache.apex.malhar.flume.interceptor.ColumnFilteringInterceptor.Constants

start() - Method in class org.apache.apex.malhar.flume.sink.FlumeSink

start() - Method in class org.apache.apex.malhar.flume.source.HdfsTestSource

start() - Method in class org.apache.apex.malhar.flume.source.TestSource

stop() - Method in class org.apache.apex.malhar.flume.sink.FlumeSink

stop() - Method in class org.apache.apex.malhar.flume.source.HdfsTestSource

stop() - Method in class org.apache.apex.malhar.flume.source.TestSource

Storage - Interface in org.apache.apex.malhar.flume.storage

Storage interface.

store(Slice) - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

store(Slice) - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

store(Slice) - Method in interface org.apache.apex.malhar.flume.storage.Storage

This stores the bytes and returns the unique identifier to retrieve these bytes

T

teardown() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

teardown() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

teardown() - Method in class org.apache.apex.malhar.flume.storage.DebugWrapper

teardown() - Method in class org.apache.apex.malhar.flume.storage.HDFSStorage

TestSource - Class in org.apache.apex.malhar.flume.source

TestSource class.

TestSource() - Constructor for class org.apache.apex.malhar.flume.source.TestSource

TIME_OFFSET - Static variable in class org.apache.apex.malhar.flume.sink.Server.Request

toByteArray(Event) - Method in class org.apache.apex.malhar.flume.storage.ErrorMaskingEventCodec

toByteArray(Event) - Method in class org.apache.apex.malhar.flume.storage.EventCodec

toString() - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

toString() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator.ConnectionStatus

toString() - Method in class org.apache.apex.malhar.flume.operator.AbstractFlumeInputOperator

toString() - Method in class org.apache.apex.malhar.flume.sink.Server.Request

type - Variable in class org.apache.apex.malhar.flume.sink.Server.Request

U

unadvertise(Discovery.Service<T>) - Method in interface org.apache.apex.malhar.flume.discovery.Discovery

Recall the previously published address as it's no longer valid.

unadvertise(Discovery.Service<byte[]>) - Method in class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

unregistered(SelectionKey) - Method in class org.apache.apex.malhar.flume.sink.Server

V

valueOf(String) - Static method in enum org.apache.apex.malhar.flume.sink.Server.Command

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.apex.malhar.flume.sink.Server.Command

Returns an array containing the constants of this enum type, in the order they are declared.

W

write(byte[], Slice) - Method in class org.apache.apex.malhar.flume.sink.Server.Client

writeInt(byte[], int, int) - Static method in class org.apache.apex.malhar.flume.sink.Server

writeLong(byte[], int, long) - Static method in class org.apache.apex.malhar.flume.sink.Server

Z

ZKAssistedDiscovery - Class in org.apache.apex.malhar.flume.discovery

ZKAssistedDiscovery class.

ZKAssistedDiscovery() - Constructor for class org.apache.apex.malhar.flume.discovery.ZKAssistedDiscovery

ZKAssistedDiscovery.InstanceSerializerFactory - Class in org.apache.apex.malhar.flume.discovery

A B C D E F G H I L N O P R S T U V W Z