incubator-bigtop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roman Shaposhnik (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BIGTOP-552) Enable HDFS durable sync
Date Fri, 20 Apr 2012 21:35:32 GMT

    [ https://issues.apache.org/jira/browse/BIGTOP-552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258603#comment-13258603
] 

Roman Shaposhnik commented on BIGTOP-552:
-----------------------------------------

Michael, the patch looks good and I think it can be committed. Thanks a million for taking
time to submit it!

Now, I think we can apply it as is to branch-0.3. As for trunk, Ptr and I have been talking
about moving everything to the use of extlookup lately. I'll leave it up to him to either
apply the patch as is or change it to use extlookup.
                
> Enable HDFS durable sync
> ------------------------
>
>                 Key: BIGTOP-552
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-552
>             Project: Bigtop
>          Issue Type: Bug
>          Components: Deployment
>    Affects Versions: 0.3.0
>            Reporter: Michael Morello
>             Fix For: 0.4.0
>
>         Attachments: BIGTOP-552.patch
>
>
> According to the HBase book () :
> {quote}
> HBase will lose data unless it is running on an HDFS that has a durable sync implementation.
Hadoop 0.20.2, Hadoop 0.20.203.0, and Hadoop 0.20.204.0 DO NOT have this attribute. Currently
only Hadoop versions 0.20.205.x or any release in excess of this version -- this includes
hadoop 1.0.0 -- have a working, durable sync [6]. Sync has to be explicitly enabled by setting
dfs.support.append equal to true on both the client side -- in hbase-site.xml -- and on the
serverside in hdfs-site.xml (The sync facility HBase needs is a subset of the append code
path).
> {quote}
> [http://hbase.apache.org/book.html#hadoop]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message