Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 748E5200BFB for ; Tue, 6 Dec 2016 12:11:46 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 732C9160B2A; Tue, 6 Dec 2016 11:11:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E14DC160B0C for ; Tue, 6 Dec 2016 12:11:45 +0100 (CET) Received: (qmail 33577 invoked by uid 500); 6 Dec 2016 11:11:27 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 33144 invoked by uid 99); 6 Dec 2016 11:11:26 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Dec 2016 11:11:26 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id D52B42C0413 for ; Tue, 6 Dec 2016 11:11:25 +0000 (UTC) Date: Tue, 6 Dec 2016 11:11:25 +0000 (UTC) From: "Till Rohrmann (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (FLINK-5254) Implement Yarn HA Services MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 06 Dec 2016 11:11:46 -0000 [ https://issues.apache.org/jira/browse/FLINK-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-5254: --------------------------------- Labels: flip-6 (was: ) > Implement Yarn HA Services > -------------------------- > > Key: FLINK-5254 > URL: https://issues.apache.org/jira/browse/FLINK-5254 > Project: Flink > Issue Type: Sub-task > Components: YARN > Reporter: Stephan Ewen > Labels: flip-6 > > The Yarn HighAvailability Services should be > **Default** > - This option takes the YARN Application's working directory as HA storage > - It automatically uses that working directory for the BlobStore > - It creates a HDFS based "RunningJobsRegistry" (see below) > - ResourceManager leader election has a pre-configured leader, via the configuration, pointing to the AppMaster address. > **ZooKeeper Based** > - The ZooKeeper based services use ZooKeeper for the ResourceManager and JobManager leader election. That way, they are safe against network partition scenarios that otherwise lead to "split brain" situations > A prototype for the simple "single job" {{RunningJobsRegistry}} based on HDFS is here: https://github.com/StephanEwen/incubator-flink/commit/aaa2d7758797b2d6c9b6da42be6a5c4989468e3b -- This message was sent by Atlassian JIRA (v6.3.4#6332)