Uses of Interface
org.apache.hadoop.ozone.container.common.interfaces.Container
Packages that use Container
Package
Description
This package is contains Ozone container implementation.
This package contains common ozone container interfaces.
This package contains classes for KeyValue container type.
This package contains utility classes for KeyValue container type.
Chunk manager and block manager implementations for keyvalue container type.
Chunk manager and block manager interfaces for keyvalue container type.
Tasks running in the background.
Ozone main that calls into the container layer.
-
Uses of Container in org.apache.hadoop.ozone.container.common.impl
Fields in org.apache.hadoop.ozone.container.common.impl with type parameters of type ContainerModifier and TypeFieldDescriptionstatic final Comparator<Container<?>> ContainerDataScanOrder.INSTANCEMethods in org.apache.hadoop.ozone.container.common.impl that return ContainerModifier and TypeMethodDescriptionContainer<?> ContainerSet.getContainer(long containerId) Returns the Container with specified containerId.HddsDispatcher.getContainer(long containerID) Methods in org.apache.hadoop.ozone.container.common.impl that return types with arguments of type ContainerModifier and TypeMethodDescriptionContainerSet.getContainerIterator(HddsVolume volume) Return an iterator of containers associated with the specified volume.ContainerSet.getContainerMap()ContainerSet.getContainerMapCopy()Return a copy of the containerMap.ContainerSet.getContainerMapIterator()Return an containerMap iterator overContainerSet.containerMap.ContainerSet.iterator()Methods in org.apache.hadoop.ozone.container.common.impl with parameters of type ContainerModifier and TypeMethodDescriptionbooleanContainerSet.addContainer(Container<?> container) Add Container to container map.booleanContainerSet.addContainerByOverwriteMissingContainer(Container<?> container) Add Container to container map.int -
Uses of Container in org.apache.hadoop.ozone.container.common.interfaces
Methods in org.apache.hadoop.ozone.container.common.interfaces that return ContainerModifier and TypeMethodDescriptionabstract ContainerHandler.importContainer(ContainerData containerData, InputStream rawContainerStream, TarContainerPacker packer) Imports container from a raw input stream.Methods in org.apache.hadoop.ozone.container.common.interfaces with parameters of type ContainerModifier and TypeMethodDescriptionabstract voidHandler.addFinalizedBlock(Container container, long localID) abstract voidHandler.closeContainer(Container container) Moves the Container to CLOSED state.abstract voidHandler.deleteBlock(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) Deletes the given files associated with a block of the container.abstract voidHandler.deleteContainer(Container container, boolean force) Deletes the given container.abstract voidHandler.deleteUnreferenced(Container container, long localID) Deletes the possible onDisk but unreferenced blocks/chunks with localID in the container.abstract voidHandler.exportContainer(Container container, OutputStream outputStream, TarContainerPacker packer) Exports container to the output stream.abstract org.apache.ratis.statemachine.StateMachine.DataChannelHandler.getStreamDataChannel(Container container, org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerCommandRequestProto msg) abstract org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerCommandResponseProtoHandler.handle(org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerCommandRequestProto msg, Container container, DispatcherContext dispatcherContext) abstract booleanHandler.isFinalizedBlockExist(Container container, long localID) abstract voidHandler.markContainerForClose(Container container) Marks the container for closing.abstract voidHandler.markContainerUnhealthy(Container container, ScanResult reason) Marks the container Unhealthy.voidContainerPacker.pack(Container<CONTAINERDATA> container, OutputStream destination) Compress all the container data (chunk data, metadata db AND container descriptor) to one single archive.default voidContainerPacker.persistCustomContainerState(Container<? extends ContainerData> container, byte[] descriptorContent, org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerDataProto.State state, Path containerMetadataPath) Persists the custom state for a container.abstract voidHandler.quasiCloseContainer(Container container, String reason) Moves the Container to QUASI_CLOSED state.abstract voidHandler.reconcileContainer(DNContainerOperationClient dnClient, Container<?> container, Collection<org.apache.hadoop.hdds.protocol.DatanodeDetails> peers) Triggers reconciliation of this container replica's data with its peers.protected voidHandler.sendDeferredICR(Container container) This should be called when there is no state change.protected voidThis should be called whenever there is state change.byte[]ContainerPacker.unpackContainerData(Container<CONTAINERDATA> container, InputStream inputStream, Path tmpDir, Path destContainerDir) Extract the container data to the path defined by the container.abstract voidHandler.updateContainerChecksum(Container container, ContainerMerkleTreeWriter treeWriter) Updates the container checksum information on disk and in memory and sends an ICR if the container checksum was changed from its previous value.Method parameters in org.apache.hadoop.ozone.container.common.interfaces with type arguments of type ContainerModifier and TypeMethodDescriptionstatic HandlerHandler.getHandlerForContainerType(org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerType containerType, org.apache.hadoop.hdds.conf.ConfigurationSource config, String datanodeId, ContainerSet contSet, VolumeSet volumeSet, VolumeChoosingPolicy volumeChoosingPolicy, ContainerMetrics metrics, IncrementalReportSender<Container> icrSender, ContainerChecksumTreeManager checksumManager) Constructor parameters in org.apache.hadoop.ozone.container.common.interfaces with type arguments of type ContainerModifierConstructorDescriptionprotectedHandler(org.apache.hadoop.hdds.conf.ConfigurationSource config, String datanodeId, ContainerSet contSet, VolumeSet volumeSet, ContainerMetrics containerMetrics, IncrementalReportSender<Container> icrSender) -
Uses of Container in org.apache.hadoop.ozone.container.keyvalue
Classes in org.apache.hadoop.ozone.container.keyvalue that implement ContainerModifier and TypeClassDescriptionclassClass to perform KeyValue Container operations.Methods in org.apache.hadoop.ozone.container.keyvalue that return ContainerModifier and TypeMethodDescriptionKeyValueHandler.importContainer(ContainerData originalContainerData, InputStream rawContainerStream, TarContainerPacker packer) Methods in org.apache.hadoop.ozone.container.keyvalue with parameters of type ContainerModifier and TypeMethodDescriptionvoidKeyValueHandler.addFinalizedBlock(Container container, long localID) voidKeyValueHandler.closeContainer(Container container) voidKeyValueHandler.deleteBlock(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) Called by BlockDeletingService to delete all the chunks in a block before proceeding to delete the block info from DB.voidKeyValueHandler.deleteContainer(Container container, boolean force) voidKeyValueHandler.deleteUnreferenced(Container container, long localID) voidKeyValueHandler.exportContainer(Container container, OutputStream outputStream, TarContainerPacker packer) org.apache.ratis.statemachine.StateMachine.DataChannelKeyValueHandler.getStreamDataChannel(Container container, org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerCommandRequestProto msg) org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerCommandResponseProtoKeyValueHandler.handle(org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos.ContainerCommandRequestProto request, Container container, DispatcherContext dispatcherContext) booleanKeyValueHandler.isFinalizedBlockExist(Container container, long localID) voidKeyValueHandler.markContainerForClose(Container container) voidKeyValueHandler.markContainerUnhealthy(Container container, ScanResult reason) voidTarContainerPacker.pack(Container<KeyValueContainerData> container, OutputStream output) Given a containerData include all the required container data/metadata in a tar file.voidKeyValueHandler.quasiCloseContainer(Container container, String reason) voidKeyValueHandler.reconcileContainer(DNContainerOperationClient dnClient, Container<?> container, Collection<org.apache.hadoop.hdds.protocol.DatanodeDetails> peers) byte[]TarContainerPacker.unpackContainerData(Container<KeyValueContainerData> container, InputStream input, Path tmpDir, Path destContainerDir) Given an input stream (tar file) extract the data to the specified directories.voidKeyValueHandler.updateContainerChecksum(Container container, ContainerMerkleTreeWriter treeWriter) Constructor parameters in org.apache.hadoop.ozone.container.keyvalue with type arguments of type ContainerModifierConstructorDescriptionKeyValueHandler(org.apache.hadoop.hdds.conf.ConfigurationSource config, String datanodeId, ContainerSet contSet, VolumeSet volSet, ContainerMetrics metrics, IncrementalReportSender<Container> icrSender, ContainerChecksumTreeManager checksumManager) KeyValueHandler(org.apache.hadoop.hdds.conf.ConfigurationSource config, String datanodeId, ContainerSet contSet, VolumeSet volSet, VolumeChoosingPolicy volumeChoosingPolicy, ContainerMetrics metrics, IncrementalReportSender<Container> icrSender, Clock clock, ContainerChecksumTreeManager checksumManager) -
Uses of Container in org.apache.hadoop.ozone.container.keyvalue.helpers
Methods in org.apache.hadoop.ozone.container.keyvalue.helpers with parameters of type ContainerModifier and TypeMethodDescriptionstatic voidBlockUtils.verifyBCSId(Container container, org.apache.hadoop.hdds.client.BlockID blockID) Verify if request block BCSID is supported.static voidBlockUtils.verifyReplicaIdx(Container container, org.apache.hadoop.hdds.client.BlockID blockID) Verify if request's replicaIndex matches with containerData. -
Uses of Container in org.apache.hadoop.ozone.container.keyvalue.impl
Methods in org.apache.hadoop.ozone.container.keyvalue.impl with parameters of type ContainerModifier and TypeMethodDescriptionbooleanBlockManagerImpl.blockExists(Container container, org.apache.hadoop.hdds.client.BlockID blockID) voidBlockManagerImpl.deleteBlock(Container container, org.apache.hadoop.hdds.client.BlockID blockID) Deletes an existing block.voidChunkManagerDispatcher.deleteChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info) voidChunkManagerDummyImpl.deleteChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info) voidFilePerBlockStrategy.deleteChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info) voidFilePerChunkStrategy.deleteChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info) Deletes a given chunk.voidChunkManagerDispatcher.deleteChunks(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) voidChunkManagerDummyImpl.deleteChunks(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) voidFilePerBlockStrategy.deleteChunks(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) voidFilePerChunkStrategy.deleteChunks(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) voidBlockManagerImpl.finalizeBlock(Container container, org.apache.hadoop.hdds.client.BlockID blockId) org.apache.hadoop.ozone.container.common.helpers.BlockDatalongBlockManagerImpl.getCommittedBlockLength(Container container, org.apache.hadoop.hdds.client.BlockID blockID) org.apache.ratis.statemachine.StateMachine.DataChannelChunkManagerDispatcher.getStreamDataChannel(Container container, org.apache.hadoop.hdds.client.BlockID blockID, ContainerMetrics metrics) org.apache.ratis.statemachine.StateMachine.DataChannelFilePerBlockStrategy.getStreamDataChannel(Container container, org.apache.hadoop.hdds.client.BlockID blockID, ContainerMetrics metrics) List<org.apache.hadoop.ozone.container.common.helpers.BlockData> longBlockManagerImpl.putBlock(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData data) longBlockManagerImpl.putBlock(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData data, boolean endOfBlock) longBlockManagerImpl.putBlockForClosedContainer(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData data, boolean overwriteBcsId) Persists the block data for a closed container.org.apache.hadoop.ozone.common.ChunkBufferToByteStringChunkManagerDispatcher.readChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, DispatcherContext dispatcherContext) org.apache.hadoop.ozone.common.ChunkBufferChunkManagerDummyImpl.readChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, DispatcherContext dispatcherContext) return a zero-filled buffer.org.apache.hadoop.ozone.common.ChunkBufferToByteStringFilePerBlockStrategy.readChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, DispatcherContext dispatcherContext) org.apache.hadoop.ozone.common.ChunkBufferToByteStringFilePerChunkStrategy.readChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, DispatcherContext dispatcherContext) reads the data defined by a chunk.ChunkManagerDispatcher.streamInit(Container container, org.apache.hadoop.hdds.client.BlockID blockID) FilePerBlockStrategy.streamInit(Container container, org.apache.hadoop.hdds.client.BlockID blockID) voidChunkManagerDispatcher.writeChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, org.apache.hadoop.ozone.common.ChunkBuffer data, DispatcherContext dispatcherContext) voidChunkManagerDummyImpl.writeChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, org.apache.hadoop.ozone.common.ChunkBuffer data, DispatcherContext dispatcherContext) voidFilePerBlockStrategy.writeChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, org.apache.hadoop.ozone.common.ChunkBuffer data, DispatcherContext dispatcherContext) voidFilePerChunkStrategy.writeChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, org.apache.hadoop.ozone.common.ChunkBuffer data, DispatcherContext dispatcherContext) writes a given chunk. -
Uses of Container in org.apache.hadoop.ozone.container.keyvalue.interfaces
Methods in org.apache.hadoop.ozone.container.keyvalue.interfaces with parameters of type ContainerModifier and TypeMethodDescriptionbooleanBlockManager.blockExists(Container container, org.apache.hadoop.hdds.client.BlockID blockID) Check if a block exists in the container.voidBlockManager.deleteBlock(Container container, org.apache.hadoop.hdds.client.BlockID blockID) Deletes an existing block.voidChunkManager.deleteChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info) Deletes a given chunk.voidChunkManager.deleteChunks(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData blockData) voidBlockManager.finalizeBlock(Container container, org.apache.hadoop.hdds.client.BlockID blockId) org.apache.hadoop.ozone.container.common.helpers.BlockDataGets an existing block.longBlockManager.getCommittedBlockLength(Container container, org.apache.hadoop.hdds.client.BlockID blockID) Returns last committed length of the block.default org.apache.ratis.statemachine.StateMachine.DataChannelChunkManager.getStreamDataChannel(Container container, org.apache.hadoop.hdds.client.BlockID blockID, ContainerMetrics metrics) List<org.apache.hadoop.ozone.container.common.helpers.BlockData> List blocks in a container.longBlockManager.putBlock(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData data) Puts or overwrites a block.longBlockManager.putBlock(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData data, boolean endOfBlock) Puts or overwrites a block.longBlockManager.putBlockForClosedContainer(Container container, org.apache.hadoop.ozone.container.common.helpers.BlockData data, boolean overwriteBcsId) Persists the block data for a closed container.org.apache.hadoop.ozone.common.ChunkBufferToByteStringChunkManager.readChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, DispatcherContext dispatcherContext) reads the data defined by a chunk.default StringChunkManager.streamInit(Container container, org.apache.hadoop.hdds.client.BlockID blockID) default voidChunkManager.writeChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, ByteBuffer data, DispatcherContext dispatcherContext) voidChunkManager.writeChunk(Container container, org.apache.hadoop.hdds.client.BlockID blockID, org.apache.hadoop.ozone.container.common.helpers.ChunkInfo info, org.apache.hadoop.ozone.common.ChunkBuffer data, DispatcherContext dispatcherContext) writes a given chunk. -
Uses of Container in org.apache.hadoop.ozone.container.keyvalue.statemachine.background
Methods in org.apache.hadoop.ozone.container.keyvalue.statemachine.background with parameters of type ContainerModifier and TypeMethodDescriptionorg.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingTask.ContainerBackgroundTaskResultBlockDeletingTask.deleteViaSchema1(DBHandle meta, Container container, File dataDir, long startTime) org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingTask.ContainerBackgroundTaskResultBlockDeletingTask.deleteViaSchema2(DBHandle meta, Container container, File dataDir, long startTime) org.apache.hadoop.ozone.container.keyvalue.statemachine.background.BlockDeletingTask.ContainerBackgroundTaskResultBlockDeletingTask.deleteViaSchema3(DBHandle meta, Container container, File dataDir, long startTime) -
Uses of Container in org.apache.hadoop.ozone.container.ozoneimpl
Methods in org.apache.hadoop.ozone.container.ozoneimpl that return ContainerModifier and TypeMethodDescriptionContainerController.getContainer(long containerId) Returns the Container given a container id.ContainerController.importContainer(ContainerData containerData, InputStream rawContainerStream, TarContainerPacker packer) Methods in org.apache.hadoop.ozone.container.ozoneimpl that return types with arguments of type ContainerModifier and TypeMethodDescriptionAbstractBackgroundContainerScanner.getContainerIterator()BackgroundContainerDataScanner.getContainerIterator()BackgroundContainerMetadataScanner.getContainerIterator()ContainerController.getContainers()ContainerController.getContainers(HddsVolume volume) Return an iterator of containers which are associated with the specifiedvolume.Methods in org.apache.hadoop.ozone.container.ozoneimpl with parameters of type ContainerModifier and TypeMethodDescriptionabstract voidAbstractBackgroundContainerScanner.scanContainer(Container<?> c) voidBackgroundContainerDataScanner.scanContainer(Container<?> c) voidBackgroundContainerMetadataScanner.scanContainer(Container<?> container) OnDemandContainerScanner.scanContainer(Container<?> container, String reasonForScan) Triggers an on-demand scan of this container.OnDemandContainerScanner.scanContainerWithoutGap(Container<?> container, String reasonForScan) Triggers an on-demand scan of this container regardless of whether it was recently scanned.voidContainerScanHelper.scanData(Container<?> container, org.apache.hadoop.hdfs.util.DataTransferThrottler throttler, org.apache.hadoop.hdfs.util.Canceler canceler) voidContainerScanHelper.scanMetadata(Container<?> container) booleanContainerScanHelper.shouldScanData(Container<?> container) booleanContainerScanHelper.shouldScanMetadata(Container<?> container)