org.apache.apex.malhar.flume.storage

Interface Storage

All Known Implementing Classes:

DebugWrapper, HDFSStorage

public interface Storage

Storage interface.

Since:

0.9.2

Field Summary

Fields

Modifier and Type	Field and Description
static String	ID key in the context for Unique identifier for the storage which may be used to recover from failure.

Method Summary

Methods

Modifier and Type	Method and Description
void	clean(byte[] identifier) This is used to clean up the files identified by identifier
void	flush() This flushes the data from stream
byte[]	retrieve(byte[] identifier) This returns the data bytes for the current identifier and the identifier for next data bytes.
byte[]	retrieveNext() This returns data bytes and the identifier for the next data bytes.
byte[]	store(com.datatorrent.netlet.util.Slice bytes) This stores the bytes and returns the unique identifier to retrieve these bytes

Field Detail

ID

static final String ID

key in the context for Unique identifier for the storage which may be used to recover from failure.

See Also:

Constant Field Values

Method Detail

store

byte[] store(com.datatorrent.netlet.util.Slice bytes)

This stores the bytes and returns the unique identifier to retrieve these bytes

Parameters:

bytes -

Returns:

retrieve

byte[] retrieve(byte[] identifier)

This returns the data bytes for the current identifier and the identifier for next data bytes.
The first eight bytes contain the identifier and the remaining bytes contain the data

Parameters:

identifier -

Returns:

retrieveNext

byte[] retrieveNext()

This returns data bytes and the identifier for the next data bytes. The identifier for current data bytes is based on the retrieve method call and number of retrieveNext method calls after retrieve method call.
The first eight bytes contain the identifier and the remaining bytes contain the data

Returns:

clean

void clean(byte[] identifier)

This is used to clean up the files identified by identifier

Parameters:

identifier -

flush

void flush()

This flushes the data from stream