From hdfs-issues-return-266073-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Tue Jun 4 17:11:03 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 9E39D18064D for ; Tue, 4 Jun 2019 19:11:02 +0200 (CEST) Received: (qmail 63894 invoked by uid 500); 4 Jun 2019 17:11:01 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 63873 invoked by uid 99); 4 Jun 2019 17:11:01 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Jun 2019 17:11:01 +0000 Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 22D9CE2CFC for ; Tue, 4 Jun 2019 17:11:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 83BE12459E for ; Tue, 4 Jun 2019 17:11:00 +0000 (UTC) Date: Tue, 4 Jun 2019 17:11:00 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (HDDS-1371) Download RocksDB checkpoint from OM Leader to Follower MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDDS-1371?focusedWorklogId=3D2= 53852&page=3Dcom.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpan= el#worklog-253852 ] ASF GitHub Bot logged work on HDDS-1371: ---------------------------------------- Author: ASF GitHub Bot Created on: 04/Jun/19 17:10 Start Date: 04/Jun/19 17:10 Worklog Time Spent: 10m=20 Work Description: bharatviswa504 commented on pull request #703: HDDS= -1371. Download RocksDB checkpoint from OM Leader to Follower. URL: https://github.com/apache/hadoop/pull/703#discussion_r290402130 =20 =20 ########## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/DBC= heckpoint.java ########## @@ -55,4 +55,20 @@ */ void cleanupCheckpoint() throws IOException; =20 + /** + * Set the OM Ratis snapshot index corresponding to the OM DB checkpoint= . + * The snapshot index is the latest snapshot index saved by ratis + * snapshots. It is not guaranteed to be the last ratis index applied to + * the OM DB state. + * @param omRatisSnapshotIndex the saved ratis snapshot index + */ + void setRatisSnapshotIndex(long omRatisSnapshotIndex); =20 Review comment: I think this can be called lastTransactionAppliedIndex, so that it will = be easy to understand. If you think this should be this way, I am fine with it too.. =20 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. =20 For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 253852) Time Spent: 3.5h (was: 3h 20m) > Download RocksDB checkpoint from OM Leader to Follower > ------------------------------------------------------ > > Key: HDDS-1371 > URL: https://issues.apache.org/jira/browse/HDDS-1371 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Reporter: Hanisha Koneru > Assignee: Hanisha Koneru > Priority: Major > Labels: pull-request-available > Time Spent: 3.5h > Remaining Estimate: 0h > > If a follower OM is lagging way behind the leader OM or in case of a rest= art or bootstrapping, a follower OM might need RocksDB checkpoint from the = leader to catch up with it. This is because the leader might have purged it= s logs after taking a snapshot. > This Jira aims to add support to download a RocksDB checkpoint from lead= er OM to follower OM=C2=A0through a HTTP servlet. We=C2=A0reuse the DBCheck= point servlet used by Recon server.=C2=A0 -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org