hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2234) Roll Hlog if any datanode in the write pipeline dies
Date Wed, 10 Mar 2010 15:45:27 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12843597#action_12843597
] 

stack commented on HBASE-2234:
------------------------------

I committed this patch to branch.  All tests pass but the TestHeapSize.  I'll fix that in
a sec (HBASE-2307).  I opened hbase-2306 to forward-port the patch.  Its a little awkward
at the moment since TRUNK has hadoop 0.21 in it but that might change soon making forward-port
straight-forward.

On the above buffering note above, dumb question, I presume syncFs forces dfsclient to flush
all local data out to the datanode buffers?

> Roll Hlog if any datanode in the write pipeline dies
> ----------------------------------------------------
>
>                 Key: HBASE-2234
>                 URL: https://issues.apache.org/jira/browse/HBASE-2234
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: dhruba borthakur
>            Assignee: Nicolas Spiegelberg
>            Priority: Blocker
>             Fix For: 0.20.4
>
>         Attachments: HBASE-2234-20.4-1.patch, HBASE-2234-20.4.patch
>
>
> HDFS does not replicate the last block of a file that is being written to. This means
that is datanodes in the write pipeline die, then the data blocks in the transaction log would
be experiencing reduced redundancy. It would be good if the region server can detect datanode-death
in the write pipeline while writing to the transaction log and if this happens, close the
current log an open a new one. This depends on HDFS-826

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message