Package org.apache.hadoop.ozone.om

Class SstFilteringService

java.lang.Object
org.apache.hadoop.hdds.utils.BackgroundService
org.apache.hadoop.ozone.om.SstFilteringService
All Implemented Interfaces:
org.apache.hadoop.ozone.lock.BootstrapStateHandler
public class SstFilteringService extends org.apache.hadoop.hdds.utils.BackgroundService implements org.apache.hadoop.ozone.lock.BootstrapStateHandler
When snapshots are taken, an entire snapshot of the OM RocksDB is captured and it will contain SST files corresponding to all volumes/buckets and keys and also have data from all the tables (columnFamilies) defined in the rocksdb This is a background service which will cleanup and filter out all the irrelevant and safe to delete sst files that don't correspond to the bucket on which the snapshot was taken.

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.hadoop.hdds.utils.BackgroundService

    org.apache.hadoop.hdds.utils.BackgroundService.PeriodicalTask

    Nested classes/interfaces inherited from interface org.apache.hadoop.ozone.lock.BootstrapStateHandler

    org.apache.hadoop.ozone.lock.BootstrapStateHandler.Lock

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final String
    SST_FILTERED_FILE
     

  • Constructor Summary

    Constructors
    Constructor
    Description
    SstFilteringService(long interval, TimeUnit unit, long serviceTimeout, OzoneManager ozoneManager, org.apache.hadoop.hdds.conf.OzoneConfiguration configuration)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.hadoop.ozone.lock.BootstrapStateHandler.Lock
    getBootstrapStateLock()
     
    AtomicLong
    getSnapshotFilteredCount()
     
    org.apache.hadoop.hdds.utils.BackgroundTaskQueue
    getTasks()
     
    static boolean
    isSstFiltered(org.apache.hadoop.hdds.conf.OzoneConfiguration ozoneConfiguration, org.apache.hadoop.ozone.om.helpers.SnapshotInfo snapshotInfo)
     
    void
    pause()
     
    void
    resume()
     
    void
    shutdown()
     
    void
    start()
     

    Methods inherited from class org.apache.hadoop.hdds.utils.BackgroundService

    execTaskCompletion, getExecutorService, getFuture, getIntervalMillis, getThreadCount, runPeriodicalTaskNow, setInterval, setPoolSize, setServiceTimeoutInNanos

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Field Details

  • Constructor Details

    • SstFilteringService

      public SstFilteringService(long interval, TimeUnit unit, long serviceTimeout, OzoneManager ozoneManager, org.apache.hadoop.hdds.conf.OzoneConfiguration configuration)

  • Method Details

    • isSstFiltered

      public static boolean isSstFiltered(org.apache.hadoop.hdds.conf.OzoneConfiguration ozoneConfiguration, org.apache.hadoop.ozone.om.helpers.SnapshotInfo snapshotInfo)

    • start

      public void start()
      Overrides:
      start in class org.apache.hadoop.hdds.utils.BackgroundService

    • pause

      public void pause()

    • resume

      public void resume()

    • getTasks

      public org.apache.hadoop.hdds.utils.BackgroundTaskQueue getTasks()
      Specified by:
      getTasks in class org.apache.hadoop.hdds.utils.BackgroundService

    • getSnapshotFilteredCount

      public AtomicLong getSnapshotFilteredCount()

    • getBootstrapStateLock

      public org.apache.hadoop.ozone.lock.BootstrapStateHandler.Lock getBootstrapStateLock()
      Specified by:
      getBootstrapStateLock in interface org.apache.hadoop.ozone.lock.BootstrapStateHandler

    • shutdown

      public void shutdown()
      Overrides:
      shutdown in class org.apache.hadoop.hdds.utils.BackgroundService