Package org.apache.hadoop.ozone.container.keyvalue

Class KeyValueContainerCheck

java.lang.Object

org.apache.hadoop.ozone.container.keyvalue.KeyValueContainerCheck

public class KeyValueContainerCheck
extends Object

Class to run integrity checks on Datanode Containers. Provide infra for Data Scrubbing

Constructor Summary

Constructors

Constructor	Description
KeyValueContainerCheck(org.apache.hadoop.hdds.conf.ConfigurationSource conf, KeyValueContainer container)

Method Summary

Modifier and Type	Method	Description
MetadataScanResult	fastCheck()	Run basic integrity checks on container metadata.
DataScanResult	fullCheck(org.apache.hadoop.hdfs.util.DataTransferThrottler throttler, org.apache.hadoop.hdfs.util.Canceler canceler)	full checks comprise scanning all metadata inside the container.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

KeyValueContainerCheck

public KeyValueContainerCheck(org.apache.hadoop.hdds.conf.ConfigurationSource conf,
 KeyValueContainer container)

Method Details

fastCheck

public MetadataScanResult fastCheck()
                             throws InterruptedException

Run basic integrity checks on container metadata. These checks do not look inside the metadata files. Applicable for OPEN containers.

Returns:

true : integrity checks pass, false : otherwise.

Throws:

InterruptedException

fullCheck

public DataScanResult fullCheck(org.apache.hadoop.hdfs.util.DataTransferThrottler throttler,
 org.apache.hadoop.hdfs.util.Canceler canceler)
                         throws InterruptedException

full checks comprise scanning all metadata inside the container. Including the KV database. These checks are intrusive, consume more resources compared to fast checks and should only be done on Closed or Quasi-closed Containers. Concurrency being limited to delete workflows.

fullCheck is a superset of fastCheck

Returns:

true : integrity checks pass, false : otherwise.

Throws:

InterruptedException