Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8A3CD923A for ; Thu, 29 Mar 2012 17:46:44 +0000 (UTC) Received: (qmail 571 invoked by uid 500); 29 Mar 2012 17:46:44 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 527 invoked by uid 500); 29 Mar 2012 17:46:44 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 518 invoked by uid 99); 29 Mar 2012 17:46:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Mar 2012 17:46:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Mar 2012 17:46:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 1D62734C8CF for ; Thu, 29 Mar 2012 17:46:23 +0000 (UTC) Date: Thu, 29 Mar 2012 17:46:23 +0000 (UTC) From: "Eli Collins (Commented) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <587862004.33733.1333043183122.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1909791739.38702.1332279700543.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-3120) Provide ability to enable sync without append MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241422#comment-13241422 ] Eli Collins commented on HDFS-3120: ----------------------------------- @Nicholas, mid air collision! What do you think of my last comment? > Provide ability to enable sync without append > --------------------------------------------- > > Key: HDFS-3120 > URL: https://issues.apache.org/jira/browse/HDFS-3120 > Project: Hadoop HDFS > Issue Type: Improvement > Affects Versions: 1.0.1 > Reporter: Eli Collins > Assignee: Eli Collins > > The work on branch-20-append was to support *sync*, for durable HBase WALs, not *append*. The branch-20-append implementation is known to be buggy. There's been confusion about this, we often answer queries on the list [like this|http://search-hadoop.com/m/wfed01VOIJ5]. Unfortunately, the way to enable correct sync on branch-1 for HBase is to set dfs.support.append to true in your config, which has the side effect of enabling append (which we don't want to do). > Let's add a new *dfs.support.sync* option that enables working sync (which is basically the current dfs.support.append flag modulo one place where it's not referring to sync). For compatibility, if dfs.support.append is set, dfs.support.sync will be set as well. This way someone can enable sync for HBase and still keep the current behavior that if dfs.support.append is not set then an append operation will result in an IOE indicating append is not supported. We should do this on trunk as well, as there's no reason to conflate hsync and append with a single config even if append works. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira