org.apache.accumulo.gc

Class GarbageCollectWriteAheadLogs

java.lang.Object

org.apache.accumulo.gc.GarbageCollectWriteAheadLogs

public class GarbageCollectWriteAheadLogs
extends Object

Method Summary

Modifier and Type	Method and Description
void	collect(GCStatus status) Removes all the WAL files that are no longer used.
protected Iterable<Map.Entry<Key,Value>>	getReplicationStatusForFile(Connector conn, String wal)
protected boolean	neededByReplication(Connector conn, String wal) Determine if the given WAL is needed for replication
protected int	removeReplicationEntries(Map<String,org.apache.hadoop.fs.Path> nameToFileMap, Map<String,org.apache.hadoop.fs.Path> sortedWALogs, GCStatus status)
protected boolean	timeToDelete(com.google.common.net.HostAndPort address, long wait) Determine if TServer has been dead long enough to remove associated WALs.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

collect

public void collect(GCStatus status)

Removes all the WAL files that are no longer used.

This method is not Threadsafe. SimpleGarbageCollector#run does not invoke collect in a concurrent manner.

Parameters:

status - GCStatus object

removeReplicationEntries

protected int removeReplicationEntries(Map<String,org.apache.hadoop.fs.Path> nameToFileMap,
                                       Map<String,org.apache.hadoop.fs.Path> sortedWALogs,
                                       GCStatus status)
                                throws IOException,
                                       org.apache.zookeeper.KeeperException,
                                       InterruptedException

Throws:

IOException

org.apache.zookeeper.KeeperException

InterruptedException

neededByReplication

protected boolean neededByReplication(Connector conn,
                                      String wal)

Determine if the given WAL is needed for replication

Parameters:

wal - The full path (URI)

Returns:

True if the WAL is still needed by replication (not a candidate for deletion)

getReplicationStatusForFile

protected Iterable<Map.Entry<Key,Value>> getReplicationStatusForFile(Connector conn,
                                                                     String wal)

timeToDelete

protected boolean timeToDelete(com.google.common.net.HostAndPort address,
                               long wait)

Determine if TServer has been dead long enough to remove associated WALs.

Uses a map where the key is the address and the value is the time first seen dead. If the address is not in the map, it is added with the current system nanoTime. When the passed in wait time has elapsed, this method returns true and removes the key and value from the map.

Parameters:

address - HostAndPort of dead tserver

wait - long value of elapsed millis to wait

Returns:

boolean whether enough time elapsed since the server was first seen as dead.