Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 24 May 2017 14:11:04 +0000 (UTC)
From: =?utf-8?Q?Gerg=C5=91_P=C3=A1sztor_=28JIRA=29?= <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: <JIRA.13059812.1490726723000.283500.1495635064498@Atlassian.JIRA>
In-Reply-To: <JIRA.13059812.1490726723000@Atlassian.JIRA>
References: <JIRA.13059812.1490726723000@Atlassian.JIRA> <JIRA.13059812.1490726723394@jira-lw-us.apache.org>
Subject: [jira] [Assigned] (MAPREDUCE-6870) Add configuration for MR job to
 finish when all reducers are complete (even with unfinished mappers)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Wed, 24 May 2017 14:11:11 -0000


     [ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=3Dcom.atla=
ssian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gerg=C5=91 P=C3=A1sztor reassigned MAPREDUCE-6870:
----------------------------------------

    Assignee: Peter Bacsko  (was: Gerg=C5=91 P=C3=A1sztor)

> Add configuration for MR job to finish when all reducers are complete (ev=
en with unfinished mappers)
> -------------------------------------------------------------------------=
---------------------------
>
>                 Key: MAPREDUCE-6870
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6870
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 2.6.1
>            Reporter: Zhe Zhang
>            Assignee: Peter Bacsko
>
> Even with MAPREDUCE-5817, there could still be cases where mappers get sc=
heduled before all reducers are complete, but those mappers run for long ti=
me, even after all reducers are complete. This could hurt the performance o=
f large MR jobs.
> In some cases, mappers don't have any materialize-able outcome other than=
 providing intermediate data to reducers. In that case, the job owner shoul=
d have the config option to finish the job once all reducers are complete.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org