Package org.apache.hadoop.ozone.container.metadata

Class DatanodeStoreSchemaThreeImpl

java.lang.Object

org.apache.hadoop.ozone.container.metadata.AbstractRDBStore<AbstractDatanodeDBDefinition>

org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore

org.apache.hadoop.ozone.container.metadata.DatanodeStoreWithIncrementalChunkList

org.apache.hadoop.ozone.container.metadata.DatanodeStoreSchemaThreeImpl

All Implemented Interfaces:

AutoCloseable, DatanodeStore, DBStoreManager, DeleteTransactionStore<String>, org.apache.ratis.util.UncheckedAutoCloseable

public class DatanodeStoreSchemaThreeImpl
extends DatanodeStoreWithIncrementalChunkList
implements DeleteTransactionStore<String>

Constructs a datanode store in accordance with schema version 3, which uses three column families/tables: 1. A block data table. 2. A metadata table. 3. A Delete Transaction Table. This is different from schema version 2 from these points: - All keys have containerID as prefix. - The table 3 has String as key instead of Long since we want to use prefix.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore

AbstractDatanodeStore.KeyValueBlockIterator, AbstractDatanodeStore.KeyValueBlockLocalIdIterator

Field Summary

Fields

Modifier and Type	Field	Description
static final String	DUMP_DIR
static final String	DUMP_FILE_SUFFIX

Fields inherited from class org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore

LOG

Fields inherited from interface org.apache.hadoop.ozone.container.metadata.DatanodeStore

NO_SUCH_BLOCK_ERR_MSG

Constructor Summary

Constructors

Constructor	Description
DatanodeStoreSchemaThreeImpl(org.apache.hadoop.hdds.conf.ConfigurationSource config, String dbPath, boolean openReadOnly)

Method Summary

Modifier and Type	Method	Description
void	compactionIfNeeded()
void	dumpKVContainerData(long containerID, File dumpDir)
BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData>	getBlockIterator(long containerID)
BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData>	getBlockIterator(long containerID, org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos.DeletedBlocksTransaction>	getDeleteTransactionTable()
static File	getDumpDir(File metaDir)
BlockIterator<Long>	getFinalizeBlockIterator(long containerID, org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
static File	getTableDumpFile(org.apache.hadoop.hdds.utils.db.Table<String,?> table, File dumpDir)
void	loadKVContainerData(File dumpDir)
void	removeKVContainerData(long containerID)

Methods inherited from class org.apache.hadoop.ozone.container.metadata.DatanodeStoreWithIncrementalChunkList

getCompleteBlockData, putBlockByID

Methods inherited from class org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore

getBlockDataTable, getBlockDataTableWithIterator, getDeletedBlocksTable, getFinalizeBlocksTable, getFinalizeBlocksTableWithIterator, getLastChunkInfoTable, getMetadataTable, initDBStore

Methods inherited from class org.apache.hadoop.ozone.container.metadata.AbstractRDBStore

close, compactDB, flushDB, flushLog, getBatchHandler, getDbDef, getDbProfile, getStore, isClosed, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.ozone.container.metadata.DatanodeStore

getBlockByID

Methods inherited from interface org.apache.hadoop.ozone.container.metadata.DBStoreManager

compactDB, flushDB, flushLog, getBatchHandler, getStore, isClosed, stop

Methods inherited from interface org.apache.ratis.util.UncheckedAutoCloseable

close

Field Details

DUMP_FILE_SUFFIX

public static final String DUMP_FILE_SUFFIX

See Also:

• Constant Field Values

DUMP_DIR

public static final String DUMP_DIR

See Also:

• Constant Field Values

Constructor Details

DatanodeStoreSchemaThreeImpl

public DatanodeStoreSchemaThreeImpl(org.apache.hadoop.hdds.conf.ConfigurationSource config,
 String dbPath,
 boolean openReadOnly)
                             throws IOException

Throws:

IOException

Method Details

getDeleteTransactionTable

public org.apache.hadoop.hdds.utils.db.Table<String,org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos.DeletedBlocksTransaction> getDeleteTransactionTable()

Specified by:

getDeleteTransactionTable in interface DeleteTransactionStore<String>

getBlockIterator

public BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData> getBlockIterator(long containerID)
                                                                                           throws IOException

Specified by:

getBlockIterator in interface DatanodeStore

Overrides:

getBlockIterator in class AbstractDatanodeStore

Throws:

IOException

getBlockIterator

public BlockIterator<org.apache.hadoop.ozone.container.common.helpers.BlockData> getBlockIterator(long containerID,
 org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
                                                                                           throws IOException

Specified by:

getBlockIterator in interface DatanodeStore

Overrides:

getBlockIterator in class AbstractDatanodeStore

Throws:

IOException

getFinalizeBlockIterator

public BlockIterator<Long> getFinalizeBlockIterator(long containerID,
 org.apache.hadoop.hdds.utils.MetadataKeyFilters.KeyPrefixFilter filter)
                                             throws IOException

Specified by:

getFinalizeBlockIterator in interface DatanodeStore

Overrides:

getFinalizeBlockIterator in class AbstractDatanodeStore

Throws:

IOException

removeKVContainerData

public void removeKVContainerData(long containerID)
                           throws IOException

Throws:

IOException

dumpKVContainerData

public void dumpKVContainerData(long containerID,
 File dumpDir)
                         throws IOException

Throws:

IOException

loadKVContainerData

public void loadKVContainerData(File dumpDir)
                         throws IOException

Throws:

IOException

getTableDumpFile

public static File getTableDumpFile(org.apache.hadoop.hdds.utils.db.Table<String,?> table,
 File dumpDir)
                             throws IOException

Throws:

IOException

getDumpDir

public static File getDumpDir(File metaDir)

compactionIfNeeded

public void compactionIfNeeded()
                        throws Exception

Specified by:

compactionIfNeeded in interface DBStoreManager

Throws:

Exception