Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 56AEB1802F for ; Mon, 22 Jun 2015 12:29:01 +0000 (UTC) Received: (qmail 94414 invoked by uid 500); 22 Jun 2015 12:29:01 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 94369 invoked by uid 500); 22 Jun 2015 12:29:01 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 94030 invoked by uid 99); 22 Jun 2015 12:29:01 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Jun 2015 12:29:01 +0000 Date: Mon, 22 Jun 2015 12:29:01 +0000 (UTC) From: "Tsuyoshi Ozawa (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (YARN-3841) [Storage abstraction] Create HDFS backing storage implementation for ATS writes MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Tsuyoshi Ozawa created YARN-3841: ------------------------------------ Summary: [Storage abstraction] Create HDFS backing storage implementation for ATS writes Key: YARN-3841 URL: https://issues.apache.org/jira/browse/YARN-3841 Project: Hadoop YARN Issue Type: Sub-task Components: timelineserver Reporter: Tsuyoshi Ozawa Assignee: Tsuyoshi Ozawa HDFS backing storage is useful for following scenarios. 1. For Hadoop clusters which don't run HBase. 2. For fallback from HBase when HBase cluster is temporary unavailable. {quote} In the case the HBase storage is not available, the plugin should buffer the writes temporarily (e.g. HDFS), and flush them once the storage comes back online. Reading and writing to hdfs as the the backup storage could potentially use the HDFS writer plugin unless the complexity of generalizing the HDFS writer plugin for this purpose exceeds the benefits of reusing it here. {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332)