Package org.apache.hadoop.ozone.container.metadata

Class AbstractDatanodeStore

java.lang.Object

org.apache.hadoop.ozone.container.metadata.AbstractRDBStore<AbstractDatanodeDBDefinition>

org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore

All Implemented Interfaces:

AutoCloseable, DatanodeStore, DBStoreManager, org.apache.ratis.util.UncheckedAutoCloseable

Direct Known Subclasses:

DatanodeStoreSchemaOneImpl, DatanodeStoreWithIncrementalChunkList

public class AbstractDatanodeStore
extends AbstractRDBStore<AbstractDatanodeDBDefinition>
implements DatanodeStore

Implementation of the DatanodeStore interface that contains functionality common to all more derived datanode store implementations.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	AbstractDatanodeStore.KeyValueBlockIterator	Block Iterator for KeyValue Container.
static class	AbstractDatanodeStore.KeyValueBlockLocalIdIterator	Block localId Iterator for KeyValue Container.

Field Summary

Fields

Modifier and Type	Field	Description
protected static final org.slf4j.Logger	LOG

Fields inherited from interface org.apache.hadoop.ozone.container.metadata.DatanodeStore

NO_SUCH_BLOCK_ERR_MSG

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	AbstractDatanodeStore(org.apache.hadoop.hdds.conf.ConfigurationSource config, AbstractDatanodeDBDefinition dbDef, boolean openReadOnly)	Constructs the metadata store and starts the DB services.

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.BlockData>	getBlockDataTable()	A Table that keeps the block data.
protected org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.BlockData>	getBlockDataTableWithIterator()
BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData>	getBlockIterator(long containerID)
BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData>	getBlockIterator(long containerID, org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.ChunkInfoList>	getDeletedBlocksTable()	A Table that keeps IDs of blocks deleted from the block data table.
BlockIterator<Long>	getFinalizeBlockIterator(long containerID, org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
org.apache.hadoop.hdds.utils.db.Table<String,Long>	getFinalizeBlocksTable()	A Table that keeps finalize blocks requested from client.
protected org.apache.hadoop.hdds.utils.db.Table<String,Long>	getFinalizeBlocksTableWithIterator()
org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.BlockData>	getLastChunkInfoTable()	A Table that keeps the metadata of the last chunk of blocks.
org.apache.hadoop.hdds.utils.db.Table<String,Long>	getMetadataTable()	A Table that keeps the metadata.
protected org.apache.hadoop.hdds.utils.db.DBStore	initDBStore(org.apache.hadoop.hdds.utils.db.DBStoreBuilder dbStoreBuilder, org.apache.hadoop.hdds.utils.db.managed.ManagedDBOptions options, org.apache.hadoop.hdds.conf.ConfigurationSource config)

Methods inherited from class org.apache.hadoop.ozone.container.metadata.AbstractRDBStore

close, compactDB, flushDB, flushLog, getBatchHandler, getDbDef, getDbProfile, getStore, isClosed, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.ozone.container.metadata.DatanodeStore

getBlockByID, getCompleteBlockData, putBlockByID

Methods inherited from interface org.apache.hadoop.ozone.container.metadata.DBStoreManager

compactDB, compactionIfNeeded, flushDB, flushLog, getBatchHandler, getStore, isClosed, stop

Methods inherited from interface org.apache.ratis.util.UncheckedAutoCloseable

close

Field Details

LOG

protected static final org.slf4j.Logger LOG

Constructor Details

AbstractDatanodeStore

protected AbstractDatanodeStore(org.apache.hadoop.hdds.conf.ConfigurationSource config,
 AbstractDatanodeDBDefinition dbDef,
 boolean openReadOnly)
                         throws org.apache.hadoop.hdds.utils.db.RocksDatabaseException,
org.apache.hadoop.hdds.utils.db.CodecException

Constructs the metadata store and starts the DB services.

Parameters:

config - - Ozone Configuration.

Throws:

org.apache.hadoop.hdds.utils.db.RocksDatabaseException

org.apache.hadoop.hdds.utils.db.CodecException

Method Details

initDBStore

protected org.apache.hadoop.hdds.utils.db.DBStore initDBStore(org.apache.hadoop.hdds.utils.db.DBStoreBuilder dbStoreBuilder,
 org.apache.hadoop.hdds.utils.db.managed.ManagedDBOptions options,
 org.apache.hadoop.hdds.conf.ConfigurationSource config)
                                                       throws org.apache.hadoop.hdds.utils.db.RocksDatabaseException,
org.apache.hadoop.hdds.utils.db.CodecException

Specified by:

initDBStore in class AbstractRDBStore<AbstractDatanodeDBDefinition>

Throws:

org.apache.hadoop.hdds.utils.db.RocksDatabaseException

org.apache.hadoop.hdds.utils.db.CodecException

getMetadataTable

public org.apache.hadoop.hdds.utils.db.Table<String,Long> getMetadataTable()

Description copied from interface: DatanodeStore

A Table that keeps the metadata.

Specified by:

getMetadataTable in interface DatanodeStore

Returns:

Table

getBlockDataTable

public org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.BlockData> getBlockDataTable()

Description copied from interface: DatanodeStore

A Table that keeps the block data.

Specified by:

getBlockDataTable in interface DatanodeStore

Returns:

Table

getLastChunkInfoTable

public org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.BlockData> getLastChunkInfoTable()

Description copied from interface: DatanodeStore

A Table that keeps the metadata of the last chunk of blocks.

Specified by:

getLastChunkInfoTable in interface DatanodeStore

Returns:

Table

getDeletedBlocksTable

public org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.ChunkInfoList> getDeletedBlocksTable()

Description copied from interface: DatanodeStore

A Table that keeps IDs of blocks deleted from the block data table.

Specified by:

getDeletedBlocksTable in interface DatanodeStore

Returns:

Table

getFinalizeBlocksTable

public org.apache.hadoop.hdds.utils.db.Table<String,Long> getFinalizeBlocksTable()

Description copied from interface: DatanodeStore

A Table that keeps finalize blocks requested from client.

Specified by:

getFinalizeBlocksTable in interface DatanodeStore

Returns:

Table

getBlockIterator

public BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData> getBlockIterator(long containerID)
                                                                                           throws IOException

Specified by:

getBlockIterator in interface DatanodeStore

Throws:

IOException

getBlockIterator

public BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData> getBlockIterator(long containerID,
 org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
                                                                                           throws IOException

Specified by:

getBlockIterator in interface DatanodeStore

Throws:

IOException

getFinalizeBlockIterator

public BlockIterator<Long> getFinalizeBlockIterator(long containerID,
 org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
                                             throws IOException

Specified by:

getFinalizeBlockIterator in interface DatanodeStore

Throws:

IOException

getBlockDataTableWithIterator

protected org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.ozone.container.common.helpers.BlockData> getBlockDataTableWithIterator()

getFinalizeBlocksTableWithIterator

protected org.apache.hadoop.hdds.utils.db.Table<String,Long> getFinalizeBlocksTableWithIterator()