org.apache.hadoop.hbase.replication.regionserver

Class ReplicationSourceWALReader

java.lang.Object

java.lang.Thread

org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader

All Implemented Interfaces:

Runnable

Direct Known Subclasses:

RecoveredReplicationSourceWALReader

@InterfaceAudience.Private
 @InterfaceStability.Evolving
public class ReplicationSourceWALReader
extends Thread

Reads and filters WAL entries, groups the filtered entries into batches, and puts the batches onto a queue

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

Thread.State, Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field and Description
protected BlockingQueue<org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.WALEntryBatch>	entryBatchQueue
protected int	replicationBatchCountCapacity

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
ReplicationSourceWALReader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf, PriorityBlockingQueue<org.apache.hadoop.fs.Path> logQueue, long startPosition, WALEntryFilter filter, ReplicationSource source) Creates a reader worker for a given WAL queue.

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.fs.Path	getCurrentPath()
protected void	handleEmptyWALEntryBatch(org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.WALEntryBatch batch, org.apache.hadoop.fs.Path currentPath)
boolean	isReaderRunning()
void	run()
void	setReaderRunning(boolean readerRunning)
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.WALEntryBatch	take() Retrieves the next batch of WAL entries from the queue, waiting up to the specified time for a batch to become available

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

entryBatchQueue

protected final BlockingQueue<org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.WALEntryBatch> entryBatchQueue

replicationBatchCountCapacity

protected final int replicationBatchCountCapacity

Constructor Detail

ReplicationSourceWALReader

public ReplicationSourceWALReader(org.apache.hadoop.fs.FileSystem fs,
                                  org.apache.hadoop.conf.Configuration conf,
                                  PriorityBlockingQueue<org.apache.hadoop.fs.Path> logQueue,
                                  long startPosition,
                                  WALEntryFilter filter,
                                  ReplicationSource source)

Creates a reader worker for a given WAL queue. Reads WAL entries off a given queue, batches the entries, and puts them on a batch queue.

Parameters:

fs - the files system to use

conf - configuration to use

logQueue - The WAL queue to read off of

startPosition - position in the first WAL to start reading from

filter - The filter to use while reading

source - replication source

Method Detail

run

public void run()

Specified by:

run in interface Runnable

Overrides:

run in class Thread

handleEmptyWALEntryBatch

protected void handleEmptyWALEntryBatch(org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.WALEntryBatch batch,
                                        org.apache.hadoop.fs.Path currentPath)
                                 throws InterruptedException

Throws:

InterruptedException

getCurrentPath

public org.apache.hadoop.fs.Path getCurrentPath()

take

public org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.WALEntryBatch take()
                                                                                               throws InterruptedException

Retrieves the next batch of WAL entries from the queue, waiting up to the specified time for a batch to become available

Returns:

A batch of entries, along with the position in the log after reading the batch

Throws:

InterruptedException - if interrupted while waiting

isReaderRunning

public boolean isReaderRunning()

Returns:

whether the reader thread is running

setReaderRunning

public void setReaderRunning(boolean readerRunning)

Parameters:

readerRunning - the readerRunning to set