hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsuyoshi Ozawa (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3841) [Storage abstraction] Create HDFS backing storage implementation for ATS writes
Date Mon, 22 Jun 2015 12:31:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tsuyoshi Ozawa updated YARN-3841:
---------------------------------
    Description: 
HDFS backing storage is useful for following scenarios.
1. For Hadoop clusters which don't run HBase.
2. For fallback from HBase when HBase cluster is temporary unavailable. Quoting ATS design
document of YARN-2928:
{quote}
In the case the HBase
storage is not available, the plugin should buffer the writes temporarily (e.g. HDFS), and
flush
them once the storage comes back online. Reading and writing to hdfs as the the backup storage
could potentially use the HDFS writer plugin unless the complexity of generalizing the HDFS
writer plugin for this purpose exceeds the benefits of reusing it here.
{quote}


  was:
HDFS backing storage is useful for following scenarios.
1. For Hadoop clusters which don't run HBase.
2. For fallback from HBase when HBase cluster is temporary unavailable. 
{quote}
In the case the HBase
storage is not available, the plugin should buffer the writes temporarily (e.g. HDFS), and
flush
them once the storage comes back online. Reading and writing to hdfs as the the backup storage
could potentially use the HDFS writer plugin unless the complexity of generalizing the HDFS
writer plugin for this purpose exceeds the benefits of reusing it here.
{quote}



> [Storage abstraction] Create HDFS backing storage implementation for ATS writes
> -------------------------------------------------------------------------------
>
>                 Key: YARN-3841
>                 URL: https://issues.apache.org/jira/browse/YARN-3841
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Tsuyoshi Ozawa
>            Assignee: Tsuyoshi Ozawa
>
> HDFS backing storage is useful for following scenarios.
> 1. For Hadoop clusters which don't run HBase.
> 2. For fallback from HBase when HBase cluster is temporary unavailable. Quoting ATS design
document of YARN-2928:
> {quote}
> In the case the HBase
> storage is not available, the plugin should buffer the writes temporarily (e.g. HDFS),
and flush
> them once the storage comes back online. Reading and writing to hdfs as the the backup
storage
> could potentially use the HDFS writer plugin unless the complexity of generalizing the
HDFS
> writer plugin for this purpose exceeds the benefits of reusing it here.
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message