Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A22FA20C8 for ; Fri, 29 Apr 2011 06:21:47 +0000 (UTC) Received: (qmail 80856 invoked by uid 500); 29 Apr 2011 06:21:46 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 80828 invoked by uid 500); 29 Apr 2011 06:21:45 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 80819 invoked by uid 99); 29 Apr 2011 06:21:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Apr 2011 06:21:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Apr 2011 06:21:41 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 48DF7ABA78 for ; Fri, 29 Apr 2011 06:21:03 +0000 (UTC) Date: Fri, 29 Apr 2011 06:21:03 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <386050521.11181.1304058063295.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1787927946.29634.1301697665752.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-1801) Remove use of timestamps to identify checkpoints and logs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1801: ------------------------------ Attachment: hdfs-1801.txt New patch includes the new file that makes little checkpoints of the txid > Remove use of timestamps to identify checkpoints and logs > --------------------------------------------------------- > > Key: HDFS-1801 > URL: https://issues.apache.org/jira/browse/HDFS-1801 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: Edit log branch (HDFS-1073) > > Attachments: hdfs-1801.txt, hdfs-1801.txt, hdfs-1801.txt > > > Currently, the NameNode validates checkpoint uploads by using timestamps associated with checkpoints and edit logs. However, now that we have transaction IDs that uniquely identify each point in time in the history of a namespace, it is more robust to simply use transaction IDs to identify images and edits. > This JIRA is to remove the use of editsTime and checkpointTime and replace it with: > * {{lastCheckpointTxId}} - the highest transaction ID reflected in the most recently saved fsimage file > * {{lastLogRollTxId}} - the highest transaction ID in {{edits}} when {{rollFsImage}} was called by the checkpointing node. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira