Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3FD2C1892F for ; Fri, 18 Mar 2016 20:08:34 +0000 (UTC) Received: (qmail 58888 invoked by uid 500); 18 Mar 2016 20:08:33 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 58807 invoked by uid 500); 18 Mar 2016 20:08:33 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 58779 invoked by uid 99); 18 Mar 2016 20:08:33 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Mar 2016 20:08:33 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 7350F2C1F56 for ; Fri, 18 Mar 2016 20:08:33 +0000 (UTC) Date: Fri, 18 Mar 2016 20:08:33 +0000 (UTC) From: "Gera Shegalov (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (MAPREDUCE-6653) JobSubmitter with unmanaged MRApplicationMaster MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202061#comment-15202061 ] Gera Shegalov commented on MAPREDUCE-6653: ------------------------------------------ In terms of user API we can introduce a new value for mapreduce.framework.name: yarn.local or yarn.unmanaged. > JobSubmitter with unmanaged MRApplicationMaster > ------------------------------------------------- > > Key: MAPREDUCE-6653 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6653 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: applicationmaster, client > Reporter: Gera Shegalov > > Long living DAG applications (pig, hive, etc) may launch many mapreduce jobs. Since we already have to allocate resources for these clients, we could reduce the latency of monitoring AM's, the overall number of network RPC's, the number of containers running on YARN cluster by embedding the MRAppMaster with the submitter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)