org.apache.flink.runtime.io.network.partition.hybrid

类 HsMemoryDataSpiller

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.HsMemoryDataSpiller

所有已实现的接口:

AutoCloseable

public class HsMemoryDataSpiller
extends Object
implements AutoCloseable

This component is responsible for asynchronously writing in-memory data to disk. Each spilling operation will write the disk file sequentially.

构造器概要

构造器

构造器和说明
HsMemoryDataSpiller(Path dataFilePath)

方法概要

限定符和类型	方法和说明
void	close() Close this HsMemoryDataSpiller when resultPartition is closed.
void	release() Release this HsMemoryDataSpiller when resultPartition is released.
CompletableFuture<List<HsFileDataIndex.SpilledBuffer>>	spillAsync(List<BufferWithIdentity> bufferToSpill) Spilling buffers to disk asynchronously.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HsMemoryDataSpiller

public HsMemoryDataSpiller(Path dataFilePath)
                    throws IOException

抛出:

IOException

方法详细资料

spillAsync

public CompletableFuture<List<HsFileDataIndex.SpilledBuffer>> spillAsync(List<BufferWithIdentity> bufferToSpill)

Spilling buffers to disk asynchronously.

参数:

bufferToSpill - buffers need to be spilled, must ensure that it is sorted by (subpartitionId, bufferIndex).

返回:

the completable future contains spilled buffers information.

close

public void close()

Close this HsMemoryDataSpiller when resultPartition is closed. It means spiller will no longer accept new spilling operation.

This method only called by main task thread.

指定者:

close 在接口中 AutoCloseable

release

public void release()

Release this HsMemoryDataSpiller when resultPartition is released. It means spiller will wait for all previous spilling operation done blocking and close the file channel.

This method only called by rpc thread.