org.apache.flink.streaming.runtime.operators.sink.committables

类 CommittableCollector<CommT>

java.lang.Object

org.apache.flink.streaming.runtime.operators.sink.committables.CommittableCollector<CommT>

类型参数:

CommT - type of committable

@Internal
public class CommittableCollector<CommT>
extends Object

This class is responsible to book-keep the committing progress across checkpoints and subtasks. It handles the emission of committables and the CommittableSummary.

构造器概要

构造器

构造器和说明
CommittableCollector(int subtaskId, int numberOfSubtasks)

方法概要

限定符和类型	方法和说明
void	addMessage(CommittableMessage<CommT> message) Adds a CommittableMessage to the collector to hold it until emission.
CommittableCollector<CommT>	copy() Returns a new committable collector that deep copies all internals.
Collection<? extends CheckpointCommittableManager<CommT>>	getCheckpointCommittablesUpTo(long checkpointId) Returns all CheckpointCommittableManager until the requested checkpoint id.
CommittableManager<CommT>	getEndOfInputCommittable() Returns CheckpointCommittableManager that is currently hold by the collector and associated with the EOI checkpoint id.
int	getNumberOfSubtasks() Returns number of subtasks.
int	getSubtaskId() Returns subtask id.
boolean	isFinished() Returns whether all CheckpointCommittableManager currently hold by the collector are either committed or failed.
void	merge(CommittableCollector<CommT> cc) Merges all information from an external collector into this collector.
static <CommT> CommittableCollector<CommT>	of(org.apache.flink.api.common.functions.RuntimeContext context) Creates a CommittableCollector based on the current runtime information.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

CommittableCollector

public CommittableCollector(int subtaskId,
                            int numberOfSubtasks)

方法详细资料

of

public static <CommT> CommittableCollector<CommT> of(org.apache.flink.api.common.functions.RuntimeContext context)

Creates a CommittableCollector based on the current runtime information. This method should be used for to instantiate a collector for all Sink V2.

类型参数:

CommT - type of the committable

参数:

context - holding runtime of information

返回:

CommittableCollector

addMessage

public void addMessage(CommittableMessage<CommT> message)

Adds a CommittableMessage to the collector to hold it until emission.

参数:

message - either CommittableSummary or CommittableWithLineage

getCheckpointCommittablesUpTo

public Collection<? extends CheckpointCommittableManager<CommT>> getCheckpointCommittablesUpTo(long checkpointId)

Returns all CheckpointCommittableManager until the requested checkpoint id.

参数:

checkpointId - counter

返回:

collection of CheckpointCommittableManager

getEndOfInputCommittable

@Nullable
public CommittableManager<CommT> getEndOfInputCommittable()

Returns CheckpointCommittableManager that is currently hold by the collector and associated with the EOI checkpoint id.

返回:

CheckpointCommittableManager

isFinished

public boolean isFinished()

Returns whether all CheckpointCommittableManager currently hold by the collector are either committed or failed.

返回:

state of the CheckpointCommittableManager

merge

public void merge(CommittableCollector<CommT> cc)

Merges all information from an external collector into this collector.

This method is important during recovery from existing state.

参数:

cc - other CommittableCollector

getNumberOfSubtasks

public int getNumberOfSubtasks()

Returns number of subtasks.

返回:

number of subtasks

getSubtaskId

public int getSubtaskId()

Returns subtask id.

返回:

subtask id.

copy

public CommittableCollector<CommT> copy()

Returns a new committable collector that deep copies all internals.

返回:

CommittableCollector