hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Lu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3874) Optimize and synchronize FS Reader and Writer Implementations
Date Thu, 03 Sep 2015 16:11:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729331#comment-14729331
] 

Li Lu commented on YARN-3874:
-----------------------------

bq. For fallback from HBase when HBase cluster is temporary unavailable. 
YARN-4061 is proposed to resolve this problem. I believe a single HDFS storage won't be enough
because we also need to keep data consistency after the HBase cluster is recovered. It is
not quite desirable if we put part of the data on to HBase and the other part on to HDFS.
I've started to work on that JIRA and hope to post some patch after the web UI milestone.
If you have any suggestions there, please feel free to let me know. 

> Optimize and synchronize FS Reader and Writer Implementations
> -------------------------------------------------------------
>
>                 Key: YARN-3874
>                 URL: https://issues.apache.org/jira/browse/YARN-3874
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>    Affects Versions: YARN-2928
>            Reporter: Varun Saxena
>            Assignee: Varun Saxena
>         Attachments: YARN-3874-YARN-2928.01.patch, YARN-3874-YARN-2928.02.patch, YARN-3874-YARN-2928.03.patch
>
>
> Combine FS Reader and Writer Implementations and make them consistent with each other.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message