hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-2234) Roll Hlog if any datanode in the write pipeline dies
Date Sat, 27 Feb 2010 01:16:08 GMT

     [ https://issues.apache.org/jira/browse/HBASE-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nicolas Spiegelberg updated HBASE-2234:
---------------------------------------

    Attachment: HBASE-2234-20.4.patch

Here is a patch with associated unit test.  I was trying to figure out whether to test at
the HLog or the HRegionServer level.  I wrote the same tests at both levels, but I submitted
the HRegionServer one.  Let me know if you need the other.  Note that this also includes our
group-commit code and syncFs() modifications, so it won't work straight off the trunk.

> Roll Hlog if any datanode in the write pipeline dies
> ----------------------------------------------------
>
>                 Key: HBASE-2234
>                 URL: https://issues.apache.org/jira/browse/HBASE-2234
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: dhruba borthakur
>            Assignee: stack
>             Fix For: 0.20.4, 0.21.0
>
>         Attachments: HBASE-2234-20.4.patch
>
>
> HDFS does not replicate the last block of a file that is being written to. This means
that is datanodes in the write pipeline die, then the data blocks in the transaction log would
be experiencing reduced redundancy. It would be good if the region server can detect datanode-death
in the write pipeline while writing to the transaction log and if this happens, close the
current log an open a new one. This depends on HDFS-826

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message