hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chuan Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12719) Implement lease recover in wasb file system
Date Fri, 26 May 2017 20:48:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16026817#comment-16026817
] 

Chuan Liu commented on HADOOP-12719:
------------------------------------

I am not sure lease recovery applies to WASB since it is a HDFS internal implementation. There
may be some contracts defined on the fs API that need to be met, e.g. hflush()/hsync() need
to guarantee data is persisted. I haven't worked on this for some time. HBase on Azure is
a supported feature for some time. I think you can contact the production team in Azure to
check if they have already supported your scenario.

> Implement lease recover in wasb file system
> -------------------------------------------
>
>                 Key: HADOOP-12719
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12719
>             Project: Hadoop Common
>          Issue Type: New Feature
>            Reporter: Liu Shaohui
>
> HBase depend on the lease recovery of file system to prevent the write operations from
the "dead" regionservers. 
> After HADOOP-9629, hadoop supports Azure Storage as an alternative Hadoop Compatible
File System. If we want to deploy HBase on Azure storage and keep data safety, we need to
implement lease recover in wasb file system.
> [~cnauroth] [~chuanliu]
> I don't know much about wasb. Any suggestions about how to implements this? 
> Eg, changing permission of the hlog to readonly like FSMapRUtils does?
> Thanks~



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message