hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HDDS-1649) On installSnapshot notification from OM leader, download checkpoint and reload OM state
Date Thu, 18 Jul 2019 17:24:00 GMT

     [ https://issues.apache.org/jira/browse/HDDS-1649?focusedWorklogId=279184&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279184
]

ASF GitHub Bot logged work on HDDS-1649:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 18/Jul/19 17:23
            Start Date: 18/Jul/19 17:23
    Worklog Time Spent: 10m 
      Work Description: hanishakoneru commented on pull request #948: HDDS-1649. On installSnapshot
notification from OM leader, download checkpoint and reload OM state
URL: https://github.com/apache/hadoop/pull/948#discussion_r305030842
 
 

 ##########
 File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerStateMachine.java
 ##########
 @@ -87,19 +92,21 @@ public OzoneManagerStateMachine(OzoneManagerRatisServer ratisServer)
{
     ThreadFactory build = new ThreadFactoryBuilder().setDaemon(true)
         .setNameFormat("OM StateMachine ApplyTransaction Thread - %d").build();
     this.executorService = HadoopExecutors.newSingleThreadExecutor(build);
+    this.installSnapshotExecutor = HadoopExecutors.newSingleThreadExecutor();
   }
 
   /**
    * Initializes the State Machine with the given server, group and storage.
    * TODO: Load the latest snapshot from the file system.
 
 Review comment:
   Yes thanks for catching this. On startup, we should read the saved ratis snapshot index
from disk. I will update the patch.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 279184)
    Time Spent: 5h 50m  (was: 5h 40m)

> On installSnapshot notification from OM leader, download checkpoint and reload OM state
> ---------------------------------------------------------------------------------------
>
>                 Key: HDDS-1649
>                 URL: https://issues.apache.org/jira/browse/HDDS-1649
>             Project: Hadoop Distributed Data Store
>          Issue Type: Sub-task
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 5h 50m
>  Remaining Estimate: 0h
>
> Installing a DB checkpoint on the OM involves following steps:
>  1. When an OM follower receives installSnapshot notification from OM leader, it should
initiate a new checkpoint on the OM leader and download that checkpoint through Http. 
>  2. After downloading the checkpoint, the StateMachine must be paused so that the old
OM DB can be replaced with the new downloaded checkpoint. 
>  3. The OM should be reloaded with the new state . All the services having a dependency
on the OM DB (such as MetadataManager, KeyManager etc.) must be re-initialized/ restarted.

>  4. Once the OM is ready with the new state, the state machine must be unpaused to resume
participating in the Ratis ring.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message