org.apache.flink.runtime.io.network.partition

类 HashBasedDataBuffer

java.lang.Object

org.apache.flink.runtime.io.network.partition.HashBasedDataBuffer

所有已实现的接口:

DataBuffer

public class HashBasedDataBuffer
extends Object
implements DataBuffer

* A DataBuffer implementation which sorts all appended records only by subpartition index. Records of the same subpartition keep the appended order.

Different from the SortBasedDataBuffer, in this DataBuffer implementation, memory segment boundary serves as the nature data boundary of different subpartitions, which means that one memory segment can never contain data from different subpartitions.

构造器概要

构造器

构造器和说明
HashBasedDataBuffer(LinkedList<org.apache.flink.core.memory.MemorySegment> freeSegments, BufferRecycler bufferRecycler, int numSubpartitions, int bufferSize, int numGuaranteedBuffers, int[] customReadOrder)

方法概要

限定符和类型	方法和说明
boolean	append(ByteBuffer source, int targetChannel, Buffer.DataType dataType) Partial data of the target record can be written if this HashBasedDataBuffer is full.
void	finish() Finishes this DataBuffer which means no record can be appended any more.
BufferWithChannel	getNextBuffer(org.apache.flink.core.memory.MemorySegment transitBuffer) Copies data in this DataBuffer to the target MemorySegment in channel index order and returns BufferWithChannel which contains the copied data and the corresponding channel index.
boolean	hasRemaining() Returns true if not all data appended to this DataBuffer is consumed.
boolean	isFinished() Whether this DataBuffer is finished or not.
boolean	isReleased() Whether this DataBuffer is released or not.
long	numTotalBytes() Returns the total number of bytes written to this DataBuffer.
long	numTotalRecords() Returns the total number of records written to this DataBuffer.
void	release() Releases this DataBuffer which releases all resources.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HashBasedDataBuffer

public HashBasedDataBuffer(LinkedList<org.apache.flink.core.memory.MemorySegment> freeSegments,
                           BufferRecycler bufferRecycler,
                           int numSubpartitions,
                           int bufferSize,
                           int numGuaranteedBuffers,
                           @Nullable
                           int[] customReadOrder)

方法详细资料

append

public boolean append(ByteBuffer source,
                      int targetChannel,
                      Buffer.DataType dataType)
               throws IOException

Partial data of the target record can be written if this HashBasedDataBuffer is full. The remaining data of the target record will be written to the next data region (a new data buffer or this data buffer after reset).

指定者:

append 在接口中 DataBuffer

抛出:

IOException

getNextBuffer

public BufferWithChannel getNextBuffer(org.apache.flink.core.memory.MemorySegment transitBuffer)

从接口复制的说明: DataBuffer

Copies data in this DataBuffer to the target MemorySegment in channel index order and returns BufferWithChannel which contains the copied data and the corresponding channel index.

指定者:

getNextBuffer 在接口中 DataBuffer

numTotalRecords

public long numTotalRecords()

从接口复制的说明: DataBuffer

Returns the total number of records written to this DataBuffer.

指定者:

numTotalRecords 在接口中 DataBuffer

numTotalBytes

public long numTotalBytes()

从接口复制的说明: DataBuffer

Returns the total number of bytes written to this DataBuffer.

指定者:

numTotalBytes 在接口中 DataBuffer

hasRemaining

public boolean hasRemaining()

从接口复制的说明: DataBuffer

Returns true if not all data appended to this DataBuffer is consumed.

指定者:

hasRemaining 在接口中 DataBuffer

finish

public void finish()

从接口复制的说明: DataBuffer

Finishes this DataBuffer which means no record can be appended any more.

指定者:

finish 在接口中 DataBuffer

isFinished

public boolean isFinished()

从接口复制的说明: DataBuffer

Whether this DataBuffer is finished or not.

指定者:

isFinished 在接口中 DataBuffer

release

public void release()

从接口复制的说明: DataBuffer

Releases this DataBuffer which releases all resources.

指定者:

release 在接口中 DataBuffer

isReleased

public boolean isReleased()

从接口复制的说明: DataBuffer

Whether this DataBuffer is released or not.

指定者:

isReleased 在接口中 DataBuffer