org.apache.flink.runtime.resourcemanager

类 ResourceManager<WorkerType extends ResourceIDRetrievable>

java.lang.Object

org.apache.flink.runtime.rpc.RpcEndpoint

org.apache.flink.runtime.rpc.FencedRpcEndpoint<ResourceManagerId>

org.apache.flink.runtime.resourcemanager.ResourceManager<WorkerType>

所有已实现的接口:

AutoCloseable, BlocklistListener, ClusterPartitionManager, ResourceManagerGateway, org.apache.flink.runtime.rpc.FencedRpcGateway<ResourceManagerId>, org.apache.flink.runtime.rpc.RpcGateway, org.apache.flink.util.AutoCloseableAsync

直接已知子类:

ActiveResourceManager, StandaloneResourceManager

public abstract class ResourceManager<WorkerType extends ResourceIDRetrievable>
extends org.apache.flink.runtime.rpc.FencedRpcEndpoint<ResourceManagerId>
implements ResourceManagerGateway

ResourceManager implementation. The resource manager is responsible for resource de-/allocation and bookkeeping.

It offers the following methods as part of its rpc interface to interact with him remotely:

• registerJobMaster(JobMasterId, ResourceID, String, JobID, Time) registers a JobMaster at the resource manager

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.runtime.rpc.RpcEndpoint

org.apache.flink.runtime.rpc.RpcEndpoint.MainThreadExecutor

字段概要

字段

限定符和类型	字段和说明
protected BlocklistHandler	blocklistHandler
protected Executor	ioExecutor
static String	RESOURCE_MANAGER_NAME
protected ResourceManagerMetricGroup	resourceManagerMetricGroup

从类继承的字段 org.apache.flink.runtime.rpc.RpcEndpoint

log, rpcServer

构造器概要

构造器

构造器和说明

ResourceManager(org.apache.flink.runtime.rpc.RpcService rpcService, UUID leaderSessionId, ResourceID resourceId, HeartbeatServices heartbeatServices, DelegationTokenManager delegationTokenManager, SlotManager slotManager, ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory, BlocklistHandler.Factory blocklistHandlerFactory, JobLeaderIdService jobLeaderIdService, ClusterInformation clusterInformation, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, ResourceManagerMetricGroup resourceManagerMetricGroup, org.apache.flink.api.common.time.Time rpcTimeout, Executor ioExecutor)

方法概要

限定符和类型	方法和说明
protected void	closeJobManagerConnection(org.apache.flink.api.common.JobID jobId, org.apache.flink.runtime.resourcemanager.ResourceManager.ResourceRequirementHandling resourceRequirementHandling, Exception cause) This method should be called by the framework once it detects that a currently registered job manager has failed.
protected Optional<WorkerType>	closeTaskManagerConnection(ResourceID resourceID, Exception cause) This method should be called by the framework once it detects that a currently registered task executor has failed.
CompletableFuture<Acknowledge>	declareRequiredResources(JobMasterId jobMasterId, ResourceRequirements resourceRequirements, org.apache.flink.api.common.time.Time timeout) Declares the absolute resource requirements for a job.
CompletableFuture<Acknowledge>	deregisterApplication(ApplicationStatus finalStatus, String diagnostics) Cleanup application and shut down cluster.
void	disconnectJobManager(org.apache.flink.api.common.JobID jobId, org.apache.flink.api.common.JobStatus jobStatus, Exception cause) Disconnects a JobManager specified by the given resourceID from the ResourceManager.
void	disconnectTaskManager(ResourceID resourceId, Exception cause) Disconnects a TaskManager specified by the given resourceID from the ResourceManager.
CompletableFuture<List<ShuffleDescriptor>>	getClusterPartitionsShuffleDescriptors(IntermediateDataSetID intermediateDataSetID) Get the shuffle descriptors of the cluster partitions ordered by partition number.
CompletableFuture<Integer>	getNumberOfRegisteredTaskManagers() Gets the currently registered number of TaskManagers.
protected abstract CompletableFuture<Void>	getReadyToServeFuture() Get the ready to serve future of the resource manager.
protected Map<WorkerResourceSpec,Integer>	getRequiredResources()
CompletableFuture<Void>	getStartedFuture() Completion of this future indicates that the resource manager is fully started and is ready to serve.
CompletableFuture<Void>	heartbeatFromJobManager(ResourceID resourceID) Sends the heartbeat to resource manager from job manager.
CompletableFuture<Void>	heartbeatFromTaskManager(ResourceID resourceID, TaskExecutorHeartbeatPayload heartbeatPayload) Sends the heartbeat to resource manager from task manager.
protected abstract void	initialize() Initializes the framework specific components.
protected abstract void	internalDeregisterApplication(ApplicationStatus finalStatus, String optionalDiagnostics) The framework specific code to deregister the application.
protected void	jobLeaderLostLeadership(org.apache.flink.api.common.JobID jobId, JobMasterId oldJobMasterId)
CompletableFuture<Map<IntermediateDataSetID,DataSetMetaInfo>>	listDataSets() Returns all datasets for which partitions are being tracked.
CompletableFuture<Acknowledge>	notifyNewBlockedNodes(Collection<BlockedNode> newNodes) Notify new blocked node records.
void	notifySlotAvailable(InstanceID instanceID, SlotID slotId, AllocationID allocationId) Sent by the TaskExecutor to notify the ResourceManager that a slot has become available.
protected void	onFatalError(Throwable t) Notifies the ResourceManager that a fatal error has occurred and it cannot proceed.
void	onStart()
CompletableFuture<Void>	onStop()
protected void	onWorkerRegistered(WorkerType worker)
CompletableFuture<RegistrationResponse>	registerJobMaster(JobMasterId jobMasterId, ResourceID jobManagerResourceId, String jobManagerAddress, org.apache.flink.api.common.JobID jobId, org.apache.flink.api.common.time.Time timeout) Register a JobMaster at the resource manager.
protected void	registerMetrics()
CompletableFuture<RegistrationResponse>	registerTaskExecutor(TaskExecutorRegistration taskExecutorRegistration, org.apache.flink.api.common.time.Time timeout) Register a TaskExecutor at the resource manager.
CompletableFuture<Void>	releaseClusterPartitions(IntermediateDataSetID dataSetId) Releases all partitions associated with the given dataset.
protected void	releaseResource(InstanceID instanceId, Exception cause)
protected void	removeJob(org.apache.flink.api.common.JobID jobId, Exception cause)
CompletableFuture<Void>	reportClusterPartitions(ResourceID taskExecutorId, ClusterPartitionReport clusterPartitionReport) Report the cluster partitions status in the task executor.
CompletableFuture<ResourceOverview>	requestResourceOverview(org.apache.flink.api.common.time.Time timeout) Requests the resource overview.
CompletableFuture<TaskExecutorThreadInfoGateway>	requestTaskExecutorThreadInfoGateway(ResourceID taskManagerId, org.apache.flink.api.common.time.Time timeout) Requests the TaskExecutorGateway.
CompletableFuture<TaskManagerInfoWithSlots>	requestTaskManagerDetailsInfo(ResourceID resourceId, org.apache.flink.api.common.time.Time timeout) Requests detail information about the given TaskExecutor.
CompletableFuture<TransientBlobKey>	requestTaskManagerFileUploadByName(ResourceID taskManagerId, String fileName, org.apache.flink.api.common.time.Time timeout) Request the file upload from the given TaskExecutor to the cluster's BlobServer.
CompletableFuture<TransientBlobKey>	requestTaskManagerFileUploadByType(ResourceID taskManagerId, FileType fileType, org.apache.flink.api.common.time.Time timeout) Request the file upload from the given TaskExecutor to the cluster's BlobServer.
CompletableFuture<Collection<TaskManagerInfo>>	requestTaskManagerInfo(org.apache.flink.api.common.time.Time timeout) Requests information about the registered TaskExecutor.
CompletableFuture<Collection<LogInfo>>	requestTaskManagerLogList(ResourceID taskManagerId, org.apache.flink.api.common.time.Time timeout) Request log list from the given TaskExecutor.
CompletableFuture<Collection<org.apache.flink.api.java.tuple.Tuple2<ResourceID,String>>>	requestTaskManagerMetricQueryServiceAddresses(org.apache.flink.api.common.time.Time timeout) Requests the paths for the TaskManager's MetricQueryService to query.
CompletableFuture<ThreadDumpInfo>	requestThreadDump(ResourceID taskManagerId, org.apache.flink.api.common.time.Time timeout) Requests the thread dump from the given TaskExecutor.
CompletableFuture<Acknowledge>	sendSlotReport(ResourceID taskManagerResourceId, InstanceID taskManagerRegistrationId, SlotReport slotReport, org.apache.flink.api.common.time.Time timeout) Sends the given SlotReport to the ResourceManager.
protected void	setFailUnfulfillableRequest(boolean failUnfulfillableRequest) Set SlotManager whether to fail unfulfillable slot requests.
abstract boolean	startNewWorker(WorkerResourceSpec workerResourceSpec) Allocates a resource using the worker resource specification.
abstract boolean	stopWorker(WorkerType worker) Stops the given worker.
protected abstract void	terminate() Terminates the framework specific components.
protected abstract WorkerType	workerStarted(ResourceID resourceID) Callback when a worker was started.

从类继承的方法 org.apache.flink.runtime.rpc.FencedRpcEndpoint

getFencingToken

从类继承的方法 org.apache.flink.runtime.rpc.RpcEndpoint

callAsync, closeAsync, getAddress, getEndpointId, getHostname, getMainThreadExecutor, getRpcService, getSelfGateway, getTerminationFuture, internalCallOnStart, internalCallOnStop, isRunning, registerResource, runAsync, scheduleRunAsync, scheduleRunAsync, start, stop, unregisterResource, validateRunsInMainThread

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.rpc.FencedRpcGateway

getFencingToken

从接口继承的方法 org.apache.flink.runtime.rpc.RpcGateway

getAddress, getHostname

从接口继承的方法 org.apache.flink.util.AutoCloseableAsync

close

字段详细资料

RESOURCE_MANAGER_NAME

public static final String RESOURCE_MANAGER_NAME

另请参阅:

常量字段值

resourceManagerMetricGroup

protected final ResourceManagerMetricGroup resourceManagerMetricGroup

ioExecutor

protected final Executor ioExecutor

blocklistHandler

protected final BlocklistHandler blocklistHandler

构造器详细资料

ResourceManager

public ResourceManager(org.apache.flink.runtime.rpc.RpcService rpcService,
                       UUID leaderSessionId,
                       ResourceID resourceId,
                       HeartbeatServices heartbeatServices,
                       DelegationTokenManager delegationTokenManager,
                       SlotManager slotManager,
                       ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
                       BlocklistHandler.Factory blocklistHandlerFactory,
                       JobLeaderIdService jobLeaderIdService,
                       ClusterInformation clusterInformation,
                       org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler,
                       ResourceManagerMetricGroup resourceManagerMetricGroup,
                       org.apache.flink.api.common.time.Time rpcTimeout,
                       Executor ioExecutor)

方法详细资料

onStart

public final void onStart()
                   throws Exception

覆盖:

onStart 在类中 org.apache.flink.runtime.rpc.RpcEndpoint

抛出:

Exception

getStartedFuture

public CompletableFuture<Void> getStartedFuture()

Completion of this future indicates that the resource manager is fully started and is ready to serve.

onStop

public final CompletableFuture<Void> onStop()

覆盖:

onStop 在类中 org.apache.flink.runtime.rpc.RpcEndpoint

registerJobMaster

public CompletableFuture<RegistrationResponse> registerJobMaster(JobMasterId jobMasterId,
                                                                 ResourceID jobManagerResourceId,
                                                                 String jobManagerAddress,
                                                                 org.apache.flink.api.common.JobID jobId,
                                                                 org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Register a JobMaster at the resource manager.

指定者:

registerJobMaster 在接口中 ResourceManagerGateway

参数:

jobMasterId - The fencing token for the JobMaster leader

jobManagerResourceId - The resource ID of the JobMaster that registers

jobManagerAddress - The address of the JobMaster that registers

jobId - The Job ID of the JobMaster that registers

timeout - Timeout for the future to complete

返回:

Future registration response

registerTaskExecutor

public CompletableFuture<RegistrationResponse> registerTaskExecutor(TaskExecutorRegistration taskExecutorRegistration,
                                                                    org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Register a TaskExecutor at the resource manager.

指定者:

registerTaskExecutor 在接口中 ResourceManagerGateway

参数:

taskExecutorRegistration - the task executor registration.

timeout - The timeout for the response.

返回:

The future to the response by the ResourceManager.

sendSlotReport

public CompletableFuture<Acknowledge> sendSlotReport(ResourceID taskManagerResourceId,
                                                     InstanceID taskManagerRegistrationId,
                                                     SlotReport slotReport,
                                                     org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Sends the given SlotReport to the ResourceManager.

指定者:

sendSlotReport 在接口中 ResourceManagerGateway

taskManagerRegistrationId - id identifying the sending TaskManager

slotReport - which is sent to the ResourceManager

timeout - for the operation

返回:

Future which is completed with Acknowledge once the slot report has been received.

onWorkerRegistered

protected void onWorkerRegistered(WorkerType worker)

heartbeatFromTaskManager

public CompletableFuture<Void> heartbeatFromTaskManager(ResourceID resourceID,
                                                        TaskExecutorHeartbeatPayload heartbeatPayload)

从接口复制的说明: ResourceManagerGateway

Sends the heartbeat to resource manager from task manager.

指定者:

heartbeatFromTaskManager 在接口中 ResourceManagerGateway

参数:

resourceID - unique id of the task manager

heartbeatPayload - payload from the originating TaskManager

返回:

future which is completed exceptionally if the operation fails

heartbeatFromJobManager

public CompletableFuture<Void> heartbeatFromJobManager(ResourceID resourceID)

从接口复制的说明: ResourceManagerGateway

Sends the heartbeat to resource manager from job manager.

指定者:

heartbeatFromJobManager 在接口中 ResourceManagerGateway

参数:

resourceID - unique id of the job manager

返回:

future which is completed exceptionally if the operation fails

disconnectTaskManager

public void disconnectTaskManager(ResourceID resourceId,
                                  Exception cause)

从接口复制的说明: ResourceManagerGateway

Disconnects a TaskManager specified by the given resourceID from the ResourceManager.

指定者:

disconnectTaskManager 在接口中 ResourceManagerGateway

参数:

resourceId - identifying the TaskManager to disconnect

cause - for the disconnection of the TaskManager

disconnectJobManager

public void disconnectJobManager(org.apache.flink.api.common.JobID jobId,
                                 org.apache.flink.api.common.JobStatus jobStatus,
                                 Exception cause)

从接口复制的说明: ResourceManagerGateway

Disconnects a JobManager specified by the given resourceID from the ResourceManager.

指定者:

disconnectJobManager 在接口中 ResourceManagerGateway

参数:

jobId - JobID for which the JobManager was the leader

jobStatus - status of the job at the time of disconnection

cause - for the disconnection of the JobManager

declareRequiredResources

public CompletableFuture<Acknowledge> declareRequiredResources(JobMasterId jobMasterId,
                                                               ResourceRequirements resourceRequirements,
                                                               org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Declares the absolute resource requirements for a job.

指定者:

declareRequiredResources 在接口中 ResourceManagerGateway

参数:

jobMasterId - id of the JobMaster

resourceRequirements - resource requirements

返回:

The confirmation that the requirements have been processed

notifySlotAvailable

public void notifySlotAvailable(InstanceID instanceID,
                                SlotID slotId,
                                AllocationID allocationId)

从接口复制的说明: ResourceManagerGateway

Sent by the TaskExecutor to notify the ResourceManager that a slot has become available.

指定者:

notifySlotAvailable 在接口中 ResourceManagerGateway

参数:

instanceID - TaskExecutor's instance id

slotId - The SlotID of the freed slot

allocationId - to which the slot has been allocated

deregisterApplication

public CompletableFuture<Acknowledge> deregisterApplication(ApplicationStatus finalStatus,
                                                            @Nullable
                                                            String diagnostics)

Cleanup application and shut down cluster.

指定者:

deregisterApplication 在接口中 ResourceManagerGateway

参数:

finalStatus - of the Flink application

diagnostics - diagnostics message for the Flink application or null

getNumberOfRegisteredTaskManagers

public CompletableFuture<Integer> getNumberOfRegisteredTaskManagers()

从接口复制的说明: ResourceManagerGateway

Gets the currently registered number of TaskManagers.

指定者:

getNumberOfRegisteredTaskManagers 在接口中 ResourceManagerGateway

返回:

The future to the number of registered TaskManagers.

requestTaskManagerInfo

public CompletableFuture<Collection<TaskManagerInfo>> requestTaskManagerInfo(org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Requests information about the registered TaskExecutor.

指定者:

requestTaskManagerInfo 在接口中 ResourceManagerGateway

参数:

timeout - of the request

返回:

Future collection of TaskManager information

requestTaskManagerDetailsInfo

public CompletableFuture<TaskManagerInfoWithSlots> requestTaskManagerDetailsInfo(ResourceID resourceId,
                                                                                 org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Requests detail information about the given TaskExecutor.

指定者:

requestTaskManagerDetailsInfo 在接口中 ResourceManagerGateway

参数:

resourceId - identifying the TaskExecutor for which to return information

timeout - of the request

返回:

Future TaskManager information and its allocated slots

requestResourceOverview

public CompletableFuture<ResourceOverview> requestResourceOverview(org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Requests the resource overview. The resource overview provides information about the connected TaskManagers, the total number of slots and the number of available slots.

指定者:

requestResourceOverview 在接口中 ResourceManagerGateway

参数:

timeout - of the request

返回:

Future containing the resource overview

requestTaskManagerMetricQueryServiceAddresses

public CompletableFuture<Collection<org.apache.flink.api.java.tuple.Tuple2<ResourceID,String>>> requestTaskManagerMetricQueryServiceAddresses(org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Requests the paths for the TaskManager's MetricQueryService to query.

指定者:

requestTaskManagerMetricQueryServiceAddresses 在接口中 ResourceManagerGateway

参数:

timeout - for the asynchronous operation

返回:

Future containing the collection of resource ids and the corresponding metric query service path

requestTaskManagerFileUploadByType

public CompletableFuture<TransientBlobKey> requestTaskManagerFileUploadByType(ResourceID taskManagerId,
                                                                              FileType fileType,
                                                                              org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Request the file upload from the given TaskExecutor to the cluster's BlobServer. The corresponding TransientBlobKey is returned.

指定者:

requestTaskManagerFileUploadByType 在接口中 ResourceManagerGateway

参数:

taskManagerId - identifying the TaskExecutor to upload the specified file

fileType - type of the file to upload

timeout - for the asynchronous operation

返回:

Future which is completed with the TransientBlobKey after uploading the file to the BlobServer.

requestTaskManagerFileUploadByName

public CompletableFuture<TransientBlobKey> requestTaskManagerFileUploadByName(ResourceID taskManagerId,
                                                                              String fileName,
                                                                              org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Request the file upload from the given TaskExecutor to the cluster's BlobServer. The corresponding TransientBlobKey is returned.

指定者:

requestTaskManagerFileUploadByName 在接口中 ResourceManagerGateway

参数:

taskManagerId - identifying the TaskExecutor to upload the specified file

fileName - name of the file to upload

timeout - for the asynchronous operation

返回:

Future which is completed with the TransientBlobKey after uploading the file to the BlobServer.

requestTaskManagerLogList

public CompletableFuture<Collection<LogInfo>> requestTaskManagerLogList(ResourceID taskManagerId,
                                                                        org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Request log list from the given TaskExecutor.

指定者:

requestTaskManagerLogList 在接口中 ResourceManagerGateway

参数:

taskManagerId - identifying the TaskExecutor to get log list from

timeout - for the asynchronous operation

返回:

Future which is completed with the historical log list

releaseClusterPartitions

public CompletableFuture<Void> releaseClusterPartitions(IntermediateDataSetID dataSetId)

从接口复制的说明: ClusterPartitionManager

Releases all partitions associated with the given dataset.

指定者:

releaseClusterPartitions 在接口中 ClusterPartitionManager

参数:

dataSetId - dataset for which all associated partitions should be released

返回:

future that is completed once all partitions have been released

reportClusterPartitions

public CompletableFuture<Void> reportClusterPartitions(ResourceID taskExecutorId,
                                                       ClusterPartitionReport clusterPartitionReport)

从接口复制的说明: ClusterPartitionManager

Report the cluster partitions status in the task executor.

指定者:

reportClusterPartitions 在接口中 ClusterPartitionManager

参数:

taskExecutorId - The id of the task executor.

clusterPartitionReport - The status of the cluster partitions.

返回:

future that is completed once the report have been processed.

getClusterPartitionsShuffleDescriptors

public CompletableFuture<List<ShuffleDescriptor>> getClusterPartitionsShuffleDescriptors(IntermediateDataSetID intermediateDataSetID)

从接口复制的说明: ClusterPartitionManager

Get the shuffle descriptors of the cluster partitions ordered by partition number.

指定者:

getClusterPartitionsShuffleDescriptors 在接口中 ClusterPartitionManager

参数:

intermediateDataSetID - The id of the dataset.

返回:

shuffle descriptors of the cluster partitions.

listDataSets

public CompletableFuture<Map<IntermediateDataSetID,DataSetMetaInfo>> listDataSets()

从接口复制的说明: ClusterPartitionManager

Returns all datasets for which partitions are being tracked.

指定者:

listDataSets 在接口中 ClusterPartitionManager

返回:

tracked datasets

requestThreadDump

public CompletableFuture<ThreadDumpInfo> requestThreadDump(ResourceID taskManagerId,
                                                           org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Requests the thread dump from the given TaskExecutor.

指定者:

requestThreadDump 在接口中 ResourceManagerGateway

参数:

taskManagerId - taskManagerId identifying the TaskExecutor to get the thread dump from

timeout - timeout of the asynchronous operation

返回:

Future containing the thread dump information

requestTaskExecutorThreadInfoGateway

public CompletableFuture<TaskExecutorThreadInfoGateway> requestTaskExecutorThreadInfoGateway(ResourceID taskManagerId,
                                                                                             org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: ResourceManagerGateway

Requests the TaskExecutorGateway.

指定者:

requestTaskExecutorThreadInfoGateway 在接口中 ResourceManagerGateway

参数:

taskManagerId - identifying the TaskExecutor.

返回:

Future containing the task executor gateway.

notifyNewBlockedNodes

public CompletableFuture<Acknowledge> notifyNewBlockedNodes(Collection<BlockedNode> newNodes)

从接口复制的说明: BlocklistListener

Notify new blocked node records.

指定者:

notifyNewBlockedNodes 在接口中 BlocklistListener

参数:

newNodes - the new blocked node records

返回:

Future acknowledge once the new nodes have successfully notified.

registerMetrics

protected void registerMetrics()

closeJobManagerConnection

protected void closeJobManagerConnection(org.apache.flink.api.common.JobID jobId,
                                         org.apache.flink.runtime.resourcemanager.ResourceManager.ResourceRequirementHandling resourceRequirementHandling,
                                         Exception cause)

This method should be called by the framework once it detects that a currently registered job manager has failed.

参数:

jobId - identifying the job whose leader shall be disconnected.

resourceRequirementHandling - indicating how existing resource requirements for the corresponding job should be handled

cause - The exception which cause the JobManager failed.

closeTaskManagerConnection

protected Optional<WorkerType> closeTaskManagerConnection(ResourceID resourceID,
                                                          Exception cause)

This method should be called by the framework once it detects that a currently registered task executor has failed.

参数:

resourceID - Id of the TaskManager that has failed.

cause - The exception which cause the TaskManager failed.

返回:

The WorkerType of the closed connection, or empty if already removed.

removeJob

protected void removeJob(org.apache.flink.api.common.JobID jobId,
                         Exception cause)

jobLeaderLostLeadership

protected void jobLeaderLostLeadership(org.apache.flink.api.common.JobID jobId,
                                       JobMasterId oldJobMasterId)

releaseResource

protected void releaseResource(InstanceID instanceId,
                               Exception cause)

onFatalError

protected void onFatalError(Throwable t)

Notifies the ResourceManager that a fatal error has occurred and it cannot proceed.

参数:

t - The exception describing the fatal error

initialize

protected abstract void initialize()
                            throws ResourceManagerException

Initializes the framework specific components.

抛出:

ResourceManagerException - which occurs during initialization and causes the resource manager to fail.

terminate

protected abstract void terminate()
                           throws Exception

Terminates the framework specific components.

抛出:

Exception - which occurs during termination.

internalDeregisterApplication

protected abstract void internalDeregisterApplication(ApplicationStatus finalStatus,
                                                      @Nullable
                                                      String optionalDiagnostics)
                                               throws ResourceManagerException

The framework specific code to deregister the application. This should report the application's final status and shut down the resource manager cleanly.

This method also needs to make sure all pending containers that are not registered yet are returned.

参数:

finalStatus - The application status to report.

optionalDiagnostics - A diagnostics message or null.

抛出:

ResourceManagerException - if the application could not be shut down.

startNewWorker

@VisibleForTesting
public abstract boolean startNewWorker(WorkerResourceSpec workerResourceSpec)

Allocates a resource using the worker resource specification.

参数:

workerResourceSpec - workerResourceSpec specifies the size of the to be allocated resource

返回:

whether the resource can be allocated

workerStarted

protected abstract WorkerType workerStarted(ResourceID resourceID)

Callback when a worker was started.

参数:

resourceID - The worker resource id

stopWorker

public abstract boolean stopWorker(WorkerType worker)

Stops the given worker.

参数:

worker - The worker.

返回:

True if the worker was stopped, otherwise false

getReadyToServeFuture

protected abstract CompletableFuture<Void> getReadyToServeFuture()

Get the ready to serve future of the resource manager.

返回:

The ready to serve future of the resource manager, which indicated whether it is ready to serve.

setFailUnfulfillableRequest

protected void setFailUnfulfillableRequest(boolean failUnfulfillableRequest)

Set SlotManager whether to fail unfulfillable slot requests.

参数:

failUnfulfillableRequest - whether to fail unfulfillable requests

getRequiredResources

protected Map<WorkerResourceSpec,Integer> getRequiredResources()