hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2234) Roll Hlog if any datanode in the write pipeline dies
Date Mon, 01 Mar 2010 01:30:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12839522#action_12839522
] 

Nicolas Spiegelberg commented on HBASE-2234:
--------------------------------------------

@ryan I could go a couple ways with rebindWriterFunc().  I either need the "this" pointer
to set "this.hdfs_out", in which case I don't need to explicitly pass in any params since
it's always "this.writer".  Or I could return an OutputStream and make this function static.
 I'm new to Java from an embedded C++ background; but to me it look like this is 6 of one,
half-dozen of the other.  I have a couple internal comments about this diff I may need to
apply as well, so I'll roll that change into my next diff.

> Roll Hlog if any datanode in the write pipeline dies
> ----------------------------------------------------
>
>                 Key: HBASE-2234
>                 URL: https://issues.apache.org/jira/browse/HBASE-2234
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: dhruba borthakur
>            Assignee: stack
>             Fix For: 0.20.4, 0.21.0
>
>         Attachments: HBASE-2234-20.4.patch
>
>
> HDFS does not replicate the last block of a file that is being written to. This means
that is datanodes in the write pipeline die, then the data blocks in the transaction log would
be experiencing reduced redundancy. It would be good if the region server can detect datanode-death
in the write pipeline while writing to the transaction log and if this happens, close the
current log an open a new one. This depends on HDFS-826

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message