org.apache.hadoop.hbase.master.assignment

Class AssignmentManager

java.lang.Object

org.apache.hadoop.hbase.master.assignment.AssignmentManager

All Implemented Interfaces:

ServerListener

@InterfaceAudience.Private
public class AssignmentManager
extends Object
implements ServerListener

The AssignmentManager is the coordinator for region assign/unassign operations.

• In-memory states of regions and servers are stored in RegionStates.
• hbase:meta state updates are handled by RegionStateStore.

Regions are created by CreateTable, Split, Merge. Regions are deleted by DeleteTable, Split, Merge. Assigns are triggered by CreateTable, EnableTable, Split, Merge, ServerCrash. Unassigns are triggered by DisableTable, Split, Merge

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AssignmentManager.RegionInTransitionStat

Field Summary

Fields

Modifier and Type	Field and Description
static String	ASSIGN_DISPATCH_WAIT_MSEC_CONF_KEY
static String	ASSIGN_DISPATCH_WAITQ_MAX_CONF_KEY
static String	ASSIGN_MAX_ATTEMPTS
static String	BOOTSTRAP_THREAD_POOL_SIZE_CONF_KEY
static String	METRICS_RIT_STUCK_WARNING_THRESHOLD Region in Transition metrics threshold time
static String	RIT_CHORE_INTERVAL_MSEC_CONF_KEY

Constructor Summary

Constructors

Constructor and Description
AssignmentManager(MasterServices master)
AssignmentManager(MasterServices master, RegionStateStore stateStore)

Method Summary

Modifier and Type	Method and Description
protected boolean	addRegionInTransition(RegionStates.RegionStateNode regionNode, RegionTransitionProcedure procedure)
void	assign(RegionInfo regionInfo)
void	assign(RegionInfo regionInfo, ServerName sn)
void	checkIfShouldMoveSystemRegionAsync() Start a new thread to check if there are region servers whose versions are higher than others.
AssignmentManager.RegionInTransitionStat	computeRegionInTransitionStat()
AssignProcedure	createAssignProcedure(RegionInfo regionInfo)
AssignProcedure	createAssignProcedure(RegionInfo regionInfo, ServerName targetServer)
AssignProcedure[]	createAssignProcedures(List<RegionInfo> hris) Create an array of AssignProcedures w/o specifying a target server.
MergeTableRegionsProcedure	createMergeProcedure(RegionInfo regionToMergeA, RegionInfo regionToMergeB)
MoveRegionProcedure	createMoveRegionProcedure(RegionPlan plan)
MoveRegionProcedure[]	createReopenProcedures(Collection<RegionInfo> regionInfo)
AssignProcedure[]	createRoundRobinAssignProcedures(List<RegionInfo> hris) Create round-robin assigns.
SplitTableRegionProcedure	createSplitProcedure(RegionInfo regionToSplit, byte[] splitKey)
UnassignProcedure[]	createUnassignProcedures(TableName tableName) Called by things like DisableTableProcedure to get a list of UnassignProcedure to unassign the regions of the table.
void	deleteTable(TableName tableName) Delete the region states.
List<RegionInfo>	getAssignedRegions()
protected int	getAssignMaxAttempts()
MetricsAssignmentManager	getAssignmentManagerMetrics()
org.apache.hadoop.conf.Configuration	getConfiguration()
List<ServerName>	getExcludedServersForSystemTable() Get a list of servers that this region cannot be assigned to.
ProcedureEvent	getFailoverCleanupEvent()
List<ServerName>	getFavoredNodes(RegionInfo regionInfo)
RegionInfo	getMetaRegionFromName(byte[] regionName)
Set<RegionInfo>	getMetaRegionSet()
int	getNumRegionsOpened()
RegionInfo	getRegionInfo(byte[] regionName)
RegionNormalizer	getRegionNormalizer()
List<RegionStates.RegionStateNode>	getRegionsInTransition()
RegionStates	getRegionStates()
RegionStateStore	getRegionStateStore()
Pair<Integer,Integer>	getReopenStatus(TableName tableName) Used by the client (via master) to identify if all regions have the schema updates
int	getServerVersion(ServerName serverName)
Map<ServerName,List<RegionInfo>>	getSnapShotOfAssignment(Collection<RegionInfo> regions)
void	handleMetaRITOnCrashedServer(ServerName serverName) Handle RIT of meta region against crashed server.
boolean	hasRegionsInTransition()
boolean	isCarryingMeta(ServerName serverName)
boolean	isFailoverCleanupDone() Used by ServerCrashProcedure to make sure AssignmentManager has completed the failover cleanup before re-assigning regions of dead servers.
boolean	isMetaInitialized()
boolean	isMetaLoaded()
boolean	isMetaRegion(byte[] regionName)
boolean	isMetaRegionInTransition()
boolean	isRunning()
boolean	isTableDisabled(TableName tableName)
boolean	isTableEnabled(TableName tableName)
void	joinCluster()
void	killRegionServer(RegionStates.ServerStateNode serverNode)
void	killRegionServer(ServerName serverName)
void	markRegionAsClosed(RegionStates.RegionStateNode regionNode)
void	markRegionAsClosing(RegionStates.RegionStateNode regionNode)
void	markRegionAsMerged(RegionInfo child, ServerName serverName, RegionInfo mother, RegionInfo father) When called here, the merge has happened.
void	markRegionAsOpened(RegionStates.RegionStateNode regionNode)
void	markRegionAsOpening(RegionStates.RegionStateNode regionNode)
void	markRegionAsSplit(RegionInfo parent, ServerName serverName, RegionInfo daughterA, RegionInfo daughterB)
void	move(RegionInfo regionInfo)
Future<byte[]>	moveAsync(RegionPlan regionPlan)
void	offlineRegion(RegionInfo regionInfo)
void	onlineRegion(RegionInfo regionInfo, ServerName serverName)
protected void	queueAssign(RegionStates.RegionStateNode regionNode) Add the assign operation to the assignment queue.
void	registerListener(AssignmentListener listener) Add the listener to the notification list.
protected void	removeRegionInTransition(RegionStates.RegionStateNode regionNode, RegionTransitionProcedure procedure)
void	reportOnlineRegions(ServerName serverName, int versionNumber, Set<byte[]> regionNames) the master will call this method when the RS send the regionServerReport().
org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionResponse	reportRegionStateTransition(org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionRequest req)
void	serverAdded(ServerName serverName) The server has joined the cluster.
void	serverRemoved(ServerName serverName) The server was removed from the cluster.
void	setFailoverCleanupDone(boolean b) Used by ServerCrashProcedure tests verify the ability to suspend the execution of the ServerCrashProcedure.
void	setRegionNormalizer(RegionNormalizer normalizer)
void	setRegionStateListener(RegionStateListener listener)
void	start()
void	stop()
void	submitServerCrash(ServerName serverName, boolean shouldSplitWal)
void	unassign(RegionInfo regionInfo)
void	unassign(RegionInfo regionInfo, boolean forceNewPlan)
void	undoRegionAsClosing(RegionStates.RegionStateNode regionNode)
void	undoRegionAsOpening(RegionStates.RegionStateNode regionNode)
boolean	unregisterListener(AssignmentListener listener) Remove the listener from the notification list.
boolean	waitForAssignment(RegionInfo regionInfo)
boolean	waitForAssignment(RegionInfo regionInfo, long timeout)
boolean	waitMetaInitialized(Procedure proc)
boolean	waitMetaInitialized(Procedure proc, RegionInfo regionInfo)
boolean	waitMetaLoaded(Procedure proc)
protected boolean	waitServerReportEvent(ServerName serverName, Procedure proc)
protected void	wakeMetaLoadedEvent()
protected void	wakeServerReportEvent(RegionStates.ServerStateNode serverNode)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.master.ServerListener

waiting

Field Detail

BOOTSTRAP_THREAD_POOL_SIZE_CONF_KEY

public static final String BOOTSTRAP_THREAD_POOL_SIZE_CONF_KEY

See Also:

Constant Field Values

ASSIGN_DISPATCH_WAIT_MSEC_CONF_KEY

public static final String ASSIGN_DISPATCH_WAIT_MSEC_CONF_KEY

See Also:

Constant Field Values

ASSIGN_DISPATCH_WAITQ_MAX_CONF_KEY

public static final String ASSIGN_DISPATCH_WAITQ_MAX_CONF_KEY

See Also:

Constant Field Values

RIT_CHORE_INTERVAL_MSEC_CONF_KEY

public static final String RIT_CHORE_INTERVAL_MSEC_CONF_KEY

See Also:

Constant Field Values

ASSIGN_MAX_ATTEMPTS

public static final String ASSIGN_MAX_ATTEMPTS

See Also:

Constant Field Values

METRICS_RIT_STUCK_WARNING_THRESHOLD

public static final String METRICS_RIT_STUCK_WARNING_THRESHOLD

Region in Transition metrics threshold time

See Also:

Constant Field Values

Constructor Detail

AssignmentManager

public AssignmentManager(MasterServices master)

AssignmentManager

public AssignmentManager(MasterServices master,
                         RegionStateStore stateStore)

Method Detail

start

public void start()
           throws IOException

Throws:

IOException

stop

public void stop()

isRunning

public boolean isRunning()

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

getAssignmentManagerMetrics

public MetricsAssignmentManager getAssignmentManagerMetrics()

getAssignMaxAttempts

protected int getAssignMaxAttempts()

registerListener

public void registerListener(AssignmentListener listener)

Add the listener to the notification list.

Parameters:

listener - The AssignmentListener to register

unregisterListener

public boolean unregisterListener(AssignmentListener listener)

Remove the listener from the notification list.

Parameters:

listener - The AssignmentListener to unregister

setRegionStateListener

public void setRegionStateListener(RegionStateListener listener)

setRegionNormalizer

public void setRegionNormalizer(RegionNormalizer normalizer)

getRegionNormalizer

public RegionNormalizer getRegionNormalizer()

getRegionStates

public RegionStates getRegionStates()

getRegionStateStore

public RegionStateStore getRegionStateStore()

getFavoredNodes

public List<ServerName> getFavoredNodes(RegionInfo regionInfo)

isTableEnabled

public boolean isTableEnabled(TableName tableName)

isTableDisabled

public boolean isTableDisabled(TableName tableName)

isMetaRegion

public boolean isMetaRegion(byte[] regionName)

getMetaRegionFromName

public RegionInfo getMetaRegionFromName(byte[] regionName)

isCarryingMeta

public boolean isCarryingMeta(ServerName serverName)

getMetaRegionSet

public Set<RegionInfo> getMetaRegionSet()

isMetaInitialized

public boolean isMetaInitialized()

isMetaRegionInTransition

public boolean isMetaRegionInTransition()

waitMetaInitialized

public boolean waitMetaInitialized(Procedure proc)

waitMetaInitialized

public boolean waitMetaInitialized(Procedure proc,
                                   RegionInfo regionInfo)

waitMetaLoaded

public boolean waitMetaLoaded(Procedure proc)

wakeMetaLoadedEvent

protected void wakeMetaLoadedEvent()

isMetaLoaded

public boolean isMetaLoaded()

checkIfShouldMoveSystemRegionAsync

public void checkIfShouldMoveSystemRegionAsync()

Start a new thread to check if there are region servers whose versions are higher than others. If so, move all system table regions to RS with the highest version to keep compatibility. The reason is, RS in new version may not be able to access RS in old version when there are some incompatible changes.

This method is called when a new RegionServer is added to cluster only.

assign

public void assign(RegionInfo regionInfo,
                   ServerName sn)
            throws IOException

Throws:

IOException

assign

public void assign(RegionInfo regionInfo)
            throws IOException

Throws:

IOException

unassign

public void unassign(RegionInfo regionInfo)
              throws IOException

Throws:

IOException

unassign

public void unassign(RegionInfo regionInfo,
                     boolean forceNewPlan)
              throws IOException

Throws:

IOException

move

public void move(RegionInfo regionInfo)
          throws IOException

Throws:

IOException

moveAsync

public Future<byte[]> moveAsync(RegionPlan regionPlan)
                         throws HBaseIOException

Throws:

HBaseIOException

waitForAssignment

public boolean waitForAssignment(RegionInfo regionInfo)
                          throws IOException

Throws:

IOException

waitForAssignment

public boolean waitForAssignment(RegionInfo regionInfo,
                                 long timeout)
                          throws IOException

Throws:

IOException

createRoundRobinAssignProcedures

public AssignProcedure[] createRoundRobinAssignProcedures(List<RegionInfo> hris)

Create round-robin assigns. Use on table creation to distribute out regions across cluster.

Returns:

AssignProcedures made out of the passed in hris and a call to the balancer to populate the assigns with targets chosen using round-robin (default balancer scheme). If at assign-time, the target chosen is no longer up, thats fine, the AssignProcedure will ask the balancer for a new target, and so on.

createAssignProcedures

public AssignProcedure[] createAssignProcedures(List<RegionInfo> hris)

Create an array of AssignProcedures w/o specifying a target server. If no target server, at assign time, we will try to use the former location of the region if one exists. This is how we 'retain' the old location across a server restart. Used by ServerCrashProcedure assigning regions on a server that has crashed (SCP is also used across a cluster-restart just-in-case to ensure we do cleanup of any old WALs or server processes).

createReopenProcedures

public MoveRegionProcedure[] createReopenProcedures(Collection<RegionInfo> regionInfo)
                                             throws IOException

Throws:

IOException

createUnassignProcedures

public UnassignProcedure[] createUnassignProcedures(TableName tableName)

Called by things like DisableTableProcedure to get a list of UnassignProcedure to unassign the regions of the table.

createAssignProcedure

public AssignProcedure createAssignProcedure(RegionInfo regionInfo)

createAssignProcedure

public AssignProcedure createAssignProcedure(RegionInfo regionInfo,
                                             ServerName targetServer)

createMoveRegionProcedure

public MoveRegionProcedure createMoveRegionProcedure(RegionPlan plan)
                                              throws HBaseIOException

Throws:

HBaseIOException

createSplitProcedure

public SplitTableRegionProcedure createSplitProcedure(RegionInfo regionToSplit,
                                                      byte[] splitKey)
                                               throws IOException

Throws:

IOException

createMergeProcedure

public MergeTableRegionsProcedure createMergeProcedure(RegionInfo regionToMergeA,
                                                       RegionInfo regionToMergeB)
                                                throws IOException

Throws:

IOException

deleteTable

public void deleteTable(TableName tableName)
                 throws IOException

Delete the region states. This is called by "DeleteTable"

Throws:

IOException

reportRegionStateTransition

public org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionResponse reportRegionStateTransition(org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.ReportRegionStateTransitionRequest req)
                                                                                                                                           throws PleaseHoldException

Throws:

PleaseHoldException

reportOnlineRegions

public void reportOnlineRegions(ServerName serverName,
                                int versionNumber,
                                Set<byte[]> regionNames)
                         throws YouAreDeadException

the master will call this method when the RS send the regionServerReport(). the report will contains the "hbase version" and the "online regions". this method will check the the online regions against the in-memory state of the AM, if there is a mismatch we will try to fence out the RS with the assumption that something went wrong on the RS side.

Throws:

YouAreDeadException

waitServerReportEvent

protected boolean waitServerReportEvent(ServerName serverName,
                                        Procedure proc)

wakeServerReportEvent

protected void wakeServerReportEvent(RegionStates.ServerStateNode serverNode)

computeRegionInTransitionStat

public AssignmentManager.RegionInTransitionStat computeRegionInTransitionStat()

joinCluster

public void joinCluster()
                 throws IOException

Throws:

IOException

isFailoverCleanupDone

public boolean isFailoverCleanupDone()

Used by ServerCrashProcedure to make sure AssignmentManager has completed the failover cleanup before re-assigning regions of dead servers. So that when re-assignment happens, AssignmentManager has proper region states.

setFailoverCleanupDone

public void setFailoverCleanupDone(boolean b)

Used by ServerCrashProcedure tests verify the ability to suspend the execution of the ServerCrashProcedure.

getFailoverCleanupEvent

public ProcedureEvent getFailoverCleanupEvent()

getNumRegionsOpened

public int getNumRegionsOpened()

submitServerCrash

public void submitServerCrash(ServerName serverName,
                              boolean shouldSplitWal)

offlineRegion

public void offlineRegion(RegionInfo regionInfo)

onlineRegion

public void onlineRegion(RegionInfo regionInfo,
                         ServerName serverName)

getSnapShotOfAssignment

public Map<ServerName,List<RegionInfo>> getSnapShotOfAssignment(Collection<RegionInfo> regions)

getReopenStatus

public Pair<Integer,Integer> getReopenStatus(TableName tableName)

Used by the client (via master) to identify if all regions have the schema updates

Parameters:

tableName -

Returns:

Pair indicating the status of the alter command (pending/total)

Throws:

IOException

addRegionInTransition

protected boolean addRegionInTransition(RegionStates.RegionStateNode regionNode,
                                        RegionTransitionProcedure procedure)

removeRegionInTransition

protected void removeRegionInTransition(RegionStates.RegionStateNode regionNode,
                                        RegionTransitionProcedure procedure)

hasRegionsInTransition

public boolean hasRegionsInTransition()

getRegionsInTransition

public List<RegionStates.RegionStateNode> getRegionsInTransition()

getAssignedRegions

public List<RegionInfo> getAssignedRegions()

getRegionInfo

public RegionInfo getRegionInfo(byte[] regionName)

markRegionAsOpening

public void markRegionAsOpening(RegionStates.RegionStateNode regionNode)
                         throws IOException

Throws:

IOException

undoRegionAsOpening

public void undoRegionAsOpening(RegionStates.RegionStateNode regionNode)

markRegionAsOpened

public void markRegionAsOpened(RegionStates.RegionStateNode regionNode)
                        throws IOException

Throws:

IOException

markRegionAsClosing

public void markRegionAsClosing(RegionStates.RegionStateNode regionNode)
                         throws IOException

Throws:

IOException

undoRegionAsClosing

public void undoRegionAsClosing(RegionStates.RegionStateNode regionNode)

markRegionAsClosed

public void markRegionAsClosed(RegionStates.RegionStateNode regionNode)
                        throws IOException

Throws:

IOException

markRegionAsSplit

public void markRegionAsSplit(RegionInfo parent,
                              ServerName serverName,
                              RegionInfo daughterA,
                              RegionInfo daughterB)
                       throws IOException

Throws:

IOException

markRegionAsMerged

public void markRegionAsMerged(RegionInfo child,
                               ServerName serverName,
                               RegionInfo mother,
                               RegionInfo father)
                        throws IOException

When called here, the merge has happened. The two merged regions have been unassigned and the above markRegionClosed has been called on each so they have been disassociated from a hosting Server. The merged region will be open after this call. The merged regions are removed from hbase:meta below> Later they are deleted from the filesystem by the catalog janitor running against hbase:meta. It notices when the merged region no longer holds references to the old regions.

Throws:

IOException

queueAssign

protected void queueAssign(RegionStates.RegionStateNode regionNode)

Add the assign operation to the assignment queue. The pending assignment operation will be processed, and each region will be assigned by a server using the balancer.

getExcludedServersForSystemTable

public List<ServerName> getExcludedServersForSystemTable()

Get a list of servers that this region cannot be assigned to. For system tables, we must assign them to a server with highest version.

serverAdded

public void serverAdded(ServerName serverName)

Description copied from interface: ServerListener

The server has joined the cluster.

Specified by:

serverAdded in interface ServerListener

Parameters:

serverName - The remote servers name.

serverRemoved

public void serverRemoved(ServerName serverName)

Description copied from interface: ServerListener

The server was removed from the cluster.

Specified by:

serverRemoved in interface ServerListener

Parameters:

serverName - The remote servers name.

getServerVersion

public int getServerVersion(ServerName serverName)

killRegionServer

public void killRegionServer(ServerName serverName)

killRegionServer

public void killRegionServer(RegionStates.ServerStateNode serverNode)

handleMetaRITOnCrashedServer

public void handleMetaRITOnCrashedServer(ServerName serverName)

Handle RIT of meta region against crashed server. Only used when ServerCrashProcedure is not enabled. See handleRIT in ServerCrashProcedure for similar function.

Parameters:

serverName - Server that has already crashed