hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Himanshu Vashishtha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8156) Support for Namenode HA for non-idempotent operations
Date Wed, 20 Mar 2013 20:51:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13608179#comment-13608179

Himanshu Vashishtha commented on HBASE-8156:

Thanks for the reviews folks. I get more clearer picture now. 
I'll move the retry logic to HRegionFileSystem, and it also has conf attribute.
Will also incorporate your suggestions about renaming and all. Re: checkDir and other method
names, I used the same ones that are in FSUtils. 

bq. Is the below from the above a bit broad for a catch? Could it be narrowed?
I don't think so. I think all hdfs throws is an IOException. One way is to parse the exception
message to look for "not idempotent", which is just too brittle. Do you have more suggestions?

[~mbertozzi]: this calls for a another jira. I'll open it shortly. Thanks.
> Support for Namenode HA for non-idempotent operations
> -----------------------------------------------------
>                 Key: HBASE-8156
>                 URL: https://issues.apache.org/jira/browse/HBASE-8156
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Filesystem Integration
>    Affects Versions: 0.95.0
>            Reporter: Himanshu Vashishtha
>            Assignee: Himanshu Vashishtha
>             Fix For: 0.98.0
>         Attachments: HBase-8156-trunk-v1.patch
> In hadoop 2 HA, non-idempotent operations are not retried at the hdfs side. This is by
design as retrying a non-idempotent operation might not be a good design choice for some use
> HBase needs to handle the retries for such operations at its end. 
> With HBase-7806, there is already some work going on for file system abstractions. There,
HReginFileSystem sits as an abstraction between region and FS. This jira is a move in the
same direction, where it adds retry functionality for non-idempotent calls such as create,
rename and delete in HRegionFileSystem class.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message