hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aravindan Vijayan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-1105) Create an OM API that takes in a RocksDB sequence number and attempts to return all transactions after that.
Date Thu, 14 Feb 2019 14:22:00 GMT
Aravindan Vijayan created HDDS-1105:
---------------------------------------

             Summary: Create an OM API that takes in a RocksDB sequence number and attempts
to return all transactions after that.
                 Key: HDDS-1105
                 URL: https://issues.apache.org/jira/browse/HDDS-1105
             Project: Hadoop Distributed Data Store
          Issue Type: Sub-task
            Reporter: Aravindan Vijayan
            Assignee: Aravindan Vijayan


*Some context*

The FSCK server will periodically invoke this OM API passing in the most recent sequence number
of its own RocksDB instance. The OM will use the RockDB getUpdateSince() API to answer this
query. Since the getUpdateSince API only works against the RocksDB WAL, we have to configure
OM RocksDB WAL (https://github.com/facebook/rocksdb/wiki/Write-Ahead-Log) with sufficient
max size to make this API useful. If the OM cannot get all transactions since the given sequence
number (due to WAL flushing), it can error out. In that case the FSCK server can fall back
to getting the entire checkpoint snapshot implemented in HDDS-1085.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message