hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6653) JobSubmitter with unmanaged MRApplicationMaster
Date Fri, 18 Mar 2016 06:11:33 GMT
Gera Shegalov created MAPREDUCE-6653:

             Summary: JobSubmitter with unmanaged MRApplicationMaster  
                 Key: MAPREDUCE-6653
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6653
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: applicationmaster, client
            Reporter: Gera Shegalov

Long living DAG applications (pig, hive, etc) may launch many mapreduce jobs. Since we already
have to allocate resources for these clients, we could reduce the latency of monitoring AM's,
the overall number of network RPC's, the number of containers running on YARN cluster by embedding
the MRAppMaster with the submitter. 

This message was sent by Atlassian JIRA

View raw message