org.apache.apex.malhar.flume.sink

Class FlumeSink

java.lang.Object

org.apache.flume.sink.AbstractSink

org.apache.apex.malhar.flume.sink.FlumeSink

All Implemented Interfaces:

org.apache.flume.conf.Configurable, org.apache.flume.lifecycle.LifecycleAware, org.apache.flume.NamedComponent, org.apache.flume.Sink

public class FlumeSink
extends org.apache.flume.sink.AbstractSink
implements org.apache.flume.conf.Configurable

FlumeSink is a flume sink developed to ingest the data into DataTorrent DAG from flume. It's essentially a flume sink which acts as a server capable of talking to one client at a time. The client for this server is AbstractFlumeInputOperator.

<experimental>FlumeSink auto adjusts the rate at which it consumes the data from channel to match the throughput of the DAG.</experimental>

The properties you can set on the FlumeSink are:
id - string unique value identifying this sink
hostname - string value indicating the fqdn or ip address of the interface on which the server should listen
port - integer value indicating the numeric port to which the server should bind
sleepMillis - integer value indicating the number of milliseconds the process should sleep when there are no events before checking for next event again
throughputAdjustmentPercent - integer value indicating by what percentage the flume transaction size should be adjusted upward or downward at a time
minimumEventsPerTransaction - integer value indicating the minimum number of events per transaction
maximumEventsPerTransaction - integer value indicating the maximum number of events per transaction. This value can not be more than channel's transaction capacity.

Since:

0.9.2

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flume.Sink

org.apache.flume.Sink.Status

Constructor Summary

Constructors

Constructor and Description
FlumeSink()

Method Summary

Methods

Modifier and Type	Method and Description
void	configure(org.apache.flume.Context context)
long	getAcceptedTolerance()
org.apache.flume.Sink.Status	process()
void	setAcceptedTolerance(long acceptedTolerance)
void	start()
void	stop()

Methods inherited from class org.apache.flume.sink.AbstractSink

getChannel, getLifecycleState, getName, setChannel, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

FlumeSink

public FlumeSink()

Method Detail

process

public org.apache.flume.Sink.Status process()
                                     throws org.apache.flume.EventDeliveryException

Specified by:

process in interface org.apache.flume.Sink

Throws:

org.apache.flume.EventDeliveryException

start

public void start()

Specified by:

start in interface org.apache.flume.lifecycle.LifecycleAware

Overrides:

start in class org.apache.flume.sink.AbstractSink

stop

public void stop()

Specified by:

stop in interface org.apache.flume.lifecycle.LifecycleAware

Overrides:

stop in class org.apache.flume.sink.AbstractSink

configure

public void configure(org.apache.flume.Context context)

Specified by:

configure in interface org.apache.flume.conf.Configurable

getAcceptedTolerance

public long getAcceptedTolerance()

setAcceptedTolerance

public void setAcceptedTolerance(long acceptedTolerance)