From mapreduce-issues-return-94500-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Tue May 26 07:09:03 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 65E67180608 for ; Tue, 26 May 2020 09:09:03 +0200 (CEST) Received: (qmail 8193 invoked by uid 500); 26 May 2020 07:09:02 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 8151 invoked by uid 99); 26 May 2020 07:09:02 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 May 2020 07:09:02 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id A3176E313D for ; Tue, 26 May 2020 07:09:01 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 581A278059B for ; Tue, 26 May 2020 07:09:00 +0000 (UTC) Date: Tue, 26 May 2020 07:09:00 +0000 (UTC) From: "Chengwei Wang (Jira)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (MAPREDUCE-7274) Enable to limit running map and reduce tasks when job is running MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-7274?page=3Dcom.atlas= sian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D= 17084662#comment-17084662 ]=20 Chengwei Wang edited comment on MAPREDUCE-7274 at 5/26/20, 7:08 AM: -------------------------------------------------------------------- upload patch for branch 3.2.0.=C2=A0 It enable us to set limit for running tasks when job is running by mapred c= lient command: {code:bash} mapred job -set-running-task-limit JOB_ID TASK_TYPE LIMIT e.g. mapred job -set-running-task-limit job_1583809537551_21297 MAP 100 mapred job -set-running-task-limit job_1583809537551_21297 REDUCE 100 {code} it send a rpc resquest to AM, and AM=C2=A0would update the max running limi= t of=C2=A0the specified type task as specified limit count. =C2=A0 =C2=A0 was (Author: smarthan): upload patch for branch 3.2.0. =C2=A0 It enable us to set limit for running tasks when job is running by mapred c= lient command: {code:bash} mapred job -set-running-task-limit JOB_ID TASK_TYPE LIMIT e.g. mapred job -set-running-task-limit job_1583809537551_21297 MAP 100 mapred job -set-running-task-limit job_1583809537551_21297 REDUCE 100 {code} it send a rpc resquest to AM, and AM=C2=A0would update the max running limi= t of=C2=A0the specified type task as specified limit count. =C2=A0 =C2=A0 > Enable to limit running map and reduce tasks when job is running > ---------------------------------------------------------------- > > Key: MAPREDUCE-7274 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7274 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: mr-am, mrv2 > Reporter: Chengwei Wang > Priority: Major > Attachments: MAPREDUCE-7274.patch > > > MRv2 enabled users to control the number of map or reduce tasks running s= imultaneously by configuration=C2=A0=C2=A0*_mapreduce.job.running.map.limit= _* or=C2=A0_*mapreduce.job.running.reduce.limit*._ But users can only set l= imit number before submitting the job to rm. So, it's meaningful=C2=A0 to e= nable users to set the limit of running map or reduce tasks when job is run= ning, which can help users to restrict=C2=A0 resource usage of job and give= resources to=C2=A0high-priority job. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org