org.apache.flink.runtime.jobmaster.slotpool

类 DeclarativeSlotPoolBridge

java.lang.Object

org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolService

org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge

所有已实现的接口:

AutoCloseable, AllocatedSlotActions, SlotPool, SlotPoolService

public class DeclarativeSlotPoolBridge
extends DeclarativeSlotPoolService
implements SlotPool

SlotPool implementation which uses the DeclarativeSlotPool to allocate slots.

字段概要

从类继承的字段 org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolService

log

构造器概要

构造器

构造器和说明
DeclarativeSlotPoolBridge(org.apache.flink.api.common.JobID jobId, DeclarativeSlotPoolFactory declarativeSlotPoolFactory, org.apache.flink.util.clock.Clock clock, org.apache.flink.api.common.time.Time rpcTimeout, org.apache.flink.api.common.time.Time idleSlotTimeout, org.apache.flink.api.common.time.Time batchSlotTimeout, RequestSlotMatchingStrategy requestSlotMatchingStrategy)

方法概要

限定符和类型	方法和说明
Optional<PhysicalSlot>	allocateAvailableSlot(SlotRequestId slotRequestId, AllocationID allocationID, ResourceProfile requirementProfile) Allocates the available slot with the given allocation id under the given request id for the given requirement profile.
<T> Optional<T>	castInto(Class<T> clazz) Tries to cast this slot pool service into the given clazz.
void	disableBatchSlotRequestTimeoutCheck() Disables batch slot request timeout check.
Collection<SlotInfo>	getAllocatedSlotsInformation() Returns a list of SlotInfo objects about all slots that are currently allocated in the slot pool.
Collection<SlotInfoWithUtilization>	getAvailableSlotsInformation() Returns a list of SlotInfoWithUtilization objects about all slots that are currently available in the slot pool.
int	getNumPendingRequests()
void	notifyNotEnoughResourcesAvailable(Collection<ResourceRequirement> acquiredResources) Notifies that not enough resources are available to fulfill the resource requirements.
Collection<SlotOffer>	offerSlots(TaskManagerLocation taskManagerLocation, TaskManagerGateway taskManagerGateway, Collection<SlotOffer> offers) Offers multiple slots to the SlotPoolService.
protected void	onClose() This method is called when the slot pool service is closed.
protected void	onFailAllocation(ResourceCounter previouslyFulfilledRequirements) This method is called when an allocation fails.
protected void	onReleaseTaskManager(ResourceCounter previouslyFulfilledRequirement) This method is called when a TaskManager is released.
protected void	onStart(org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor componentMainThreadExecutor) This method is called when the slot pool service is started.
void	releaseSlot(SlotRequestId slotRequestId, Throwable cause) Releases the slot with the given SlotRequestId.
CompletableFuture<PhysicalSlot>	requestNewAllocatedBatchSlot(SlotRequestId slotRequestId, ResourceProfile resourceProfile, Collection<AllocationID> preferredAllocations)
CompletableFuture<PhysicalSlot>	requestNewAllocatedSlot(SlotRequestId slotRequestId, ResourceProfile resourceProfile, Collection<AllocationID> preferredAllocations, org.apache.flink.api.common.time.Time timeout) Request the allocation of a new slot from the resource manager.
void	setIsJobRestarting(boolean isJobRestarting) To set whether the underlying is currently restarting or not.

从类继承的方法 org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolService

assertHasBeenStarted, close, connectToResourceManager, createAllocatedSlotReport, disconnectResourceManager, failAllocation, getDeclarativeSlotPool, getRelativeTimeMillis, getSlotServiceStatus, registerTaskManager, releaseFreeSlotsOnTaskManager, releaseTaskManager, start

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.jobmaster.slotpool.SlotPool

close, connectToResourceManager, createAllocatedSlotReport, disconnectResourceManager, registerTaskManager, releaseTaskManager, requestNewAllocatedBatchSlot, requestNewAllocatedSlot, start

构造器详细资料

DeclarativeSlotPoolBridge

public DeclarativeSlotPoolBridge(org.apache.flink.api.common.JobID jobId,
                                 DeclarativeSlotPoolFactory declarativeSlotPoolFactory,
                                 org.apache.flink.util.clock.Clock clock,
                                 org.apache.flink.api.common.time.Time rpcTimeout,
                                 org.apache.flink.api.common.time.Time idleSlotTimeout,
                                 org.apache.flink.api.common.time.Time batchSlotTimeout,
                                 RequestSlotMatchingStrategy requestSlotMatchingStrategy)

方法详细资料

castInto

public <T> Optional<T> castInto(Class<T> clazz)

从接口复制的说明: SlotPoolService

Tries to cast this slot pool service into the given clazz.

指定者:

castInto 在接口中 SlotPoolService

覆盖:

castInto 在类中 DeclarativeSlotPoolService

类型参数:

T - type of clazz

参数:

clazz - to cast the slot pool service into

返回:

Optional.of(T) the target type if it can be cast; otherwise Optional.empty()

onStart

protected void onStart(org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor componentMainThreadExecutor)

从类复制的说明: DeclarativeSlotPoolService

This method is called when the slot pool service is started. It can be overridden by subclasses.

覆盖:

onStart 在类中 DeclarativeSlotPoolService

参数:

componentMainThreadExecutor - componentMainThreadExecutor used by this slot pool service

onClose

protected void onClose()

从类复制的说明: DeclarativeSlotPoolService

This method is called when the slot pool service is closed. It can be overridden by subclasses.

覆盖:

onClose 在类中 DeclarativeSlotPoolService

setIsJobRestarting

public void setIsJobRestarting(boolean isJobRestarting)

To set whether the underlying is currently restarting or not. In the former case the slot pool bridge will accept all incoming slot offers.

指定者:

setIsJobRestarting 在接口中 SlotPool

参数:

isJobRestarting - whether this is restarting or not

offerSlots

public Collection<SlotOffer> offerSlots(TaskManagerLocation taskManagerLocation,
                                        TaskManagerGateway taskManagerGateway,
                                        Collection<SlotOffer> offers)

从接口复制的说明: SlotPoolService

Offers multiple slots to the SlotPoolService. The slot offerings can be individually accepted or rejected by returning the collection of accepted slot offers.

指定者:

offerSlots 在接口中 SlotPool

指定者:

offerSlots 在接口中 SlotPoolService

覆盖:

offerSlots 在类中 DeclarativeSlotPoolService

参数:

taskManagerLocation - from which the slot offers originate

taskManagerGateway - to talk to the slot offerer

offers - slot offers which are offered to the SlotPoolService

返回:

A collection of accepted slot offers. The remaining slot offers are implicitly rejected.

onReleaseTaskManager

protected void onReleaseTaskManager(ResourceCounter previouslyFulfilledRequirement)

从类复制的说明: DeclarativeSlotPoolService

This method is called when a TaskManager is released. It can be overridden by subclasses.

覆盖:

onReleaseTaskManager 在类中 DeclarativeSlotPoolService

参数:

previouslyFulfilledRequirement - previouslyFulfilledRequirement by the released TaskManager

allocateAvailableSlot

public Optional<PhysicalSlot> allocateAvailableSlot(@Nonnull
                                                    SlotRequestId slotRequestId,
                                                    @Nonnull
                                                    AllocationID allocationID,
                                                    @Nonnull
                                                    ResourceProfile requirementProfile)

从接口复制的说明: SlotPool

Allocates the available slot with the given allocation id under the given request id for the given requirement profile. The slot must be able to fulfill the requirement profile, otherwise an IllegalStateException will be thrown.

指定者:

allocateAvailableSlot 在接口中 SlotPool

参数:

slotRequestId - identifying the requested slot

allocationID - the allocation id of the requested available slot

requirementProfile - resource profile of the requirement for which to allocate the slot

返回:

the previously available slot with the given allocation id, if a slot with this allocation id exists

requestNewAllocatedSlot

@Nonnull
public CompletableFuture<PhysicalSlot> requestNewAllocatedSlot(@Nonnull
                                                                        SlotRequestId slotRequestId,
                                                                        @Nonnull
                                                                        ResourceProfile resourceProfile,
                                                                        @Nonnull
                                                                        Collection<AllocationID> preferredAllocations,
                                                                        @Nullable
                                                                        org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: SlotPool

Request the allocation of a new slot from the resource manager. This method will not return a slot from the already available slots from the pool, but instead will add a new slot to that pool that is immediately allocated and returned.

指定者:

requestNewAllocatedSlot 在接口中 SlotPool

参数:

slotRequestId - identifying the requested slot

resourceProfile - resource profile that specifies the resource requirements for the requested slot

preferredAllocations - preferred allocations for the new allocated slot

timeout - timeout for the allocation procedure

返回:

a newly allocated slot that was previously not available.

requestNewAllocatedBatchSlot

@Nonnull
public CompletableFuture<PhysicalSlot> requestNewAllocatedBatchSlot(@Nonnull
                                                                             SlotRequestId slotRequestId,
                                                                             @Nonnull
                                                                             ResourceProfile resourceProfile,
                                                                             @Nonnull
                                                                             Collection<AllocationID> preferredAllocations)

指定者:

requestNewAllocatedBatchSlot 在接口中 SlotPool

onFailAllocation

protected void onFailAllocation(ResourceCounter previouslyFulfilledRequirements)

从类复制的说明: DeclarativeSlotPoolService

This method is called when an allocation fails. It can be overridden by subclasses.

覆盖:

onFailAllocation 在类中 DeclarativeSlotPoolService

参数:

previouslyFulfilledRequirements - previouslyFulfilledRequirements by the failed allocation

releaseSlot

public void releaseSlot(@Nonnull
                        SlotRequestId slotRequestId,
                        @Nullable
                        Throwable cause)

从接口复制的说明: AllocatedSlotActions

Releases the slot with the given SlotRequestId. Additionally, one can provide a cause for the slot release.

指定者:

releaseSlot 在接口中 AllocatedSlotActions

参数:

slotRequestId - identifying the slot to release

cause - of the slot release, null if none

notifyNotEnoughResourcesAvailable

public void notifyNotEnoughResourcesAvailable(Collection<ResourceRequirement> acquiredResources)

从接口复制的说明: SlotPoolService

Notifies that not enough resources are available to fulfill the resource requirements.

指定者:

notifyNotEnoughResourcesAvailable 在接口中 SlotPoolService

参数:

acquiredResources - the resources that have been acquired

getAllocatedSlotsInformation

public Collection<SlotInfo> getAllocatedSlotsInformation()

从接口复制的说明: SlotPool

Returns a list of SlotInfo objects about all slots that are currently allocated in the slot pool.

指定者:

getAllocatedSlotsInformation 在接口中 SlotPool

返回:

a list of SlotInfo objects about all slots that are currently allocated in the slot pool.

getAvailableSlotsInformation

@Nonnull
public Collection<SlotInfoWithUtilization> getAvailableSlotsInformation()

从接口复制的说明: SlotPool

Returns a list of SlotInfoWithUtilization objects about all slots that are currently available in the slot pool.

指定者:

getAvailableSlotsInformation 在接口中 SlotPool

返回:

a list of SlotInfoWithUtilization objects about all slots that are currently available in the slot pool.

disableBatchSlotRequestTimeoutCheck

public void disableBatchSlotRequestTimeoutCheck()

从接口复制的说明: SlotPool

Disables batch slot request timeout check. Invoked when someone else wants to take over the timeout check responsibility.

指定者:

disableBatchSlotRequestTimeoutCheck 在接口中 SlotPool

getNumPendingRequests

@VisibleForTesting
public int getNumPendingRequests()