Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Sat, 25 Jul 2015 14:56:05 +0000 (UTC)
From: "Carlo Curino (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12830345.1431731786000.289849.1437836165607@Atlassian.JIRA>
In-Reply-To: <JIRA.12830345.1431731786000@Atlassian.JIRA>
References: <JIRA.12830345.1431731786000@Atlassian.JIRA>
 <JIRA.12830345.1431731786038@arcas>
Subject: [jira] [Commented] (YARN-3656) LowCost: A Cost-Based Placement
 Agent for YARN Reservations
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/YARN-3656?page=3Dcom.atlassian.=
jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D14641=
645#comment-14641645 ]=20

Carlo Curino commented on YARN-3656:
------------------------------------

+1 on this patch. I committed this to trunk/branch-2, after manually inspec=
ting the checkstyle and javadoc (fix a couple more but the rest will not go=
 away as checkstyle misses a few uses of link tag in javadoc).=20

Thanks [~jyaniv] and [~imenache] for this important contribution, (and for =
having tested it and polished those algos endlessly).=20
Thanks to [~subru] for helping sheparding this and [~asuresh] for reviewing=
.=20

> LowCost: A Cost-Based Placement Agent for YARN Reservations
> -----------------------------------------------------------
>
>                 Key: YARN-3656
>                 URL: https://issues.apache.org/jira/browse/YARN-3656
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler, resourcemanager
>    Affects Versions: 2.6.0
>            Reporter: Ishai Menache
>            Assignee: Jonathan Yaniv
>              Labels: capacity-scheduler, resourcemanager
>             Fix For: 2.8.0
>
>         Attachments: LowCostRayonExternal.pdf, YARN-3656-v1.1.patch, YARN=
-3656-v1.2.patch, YARN-3656-v1.3.patch, YARN-3656-v1.4.patch, YARN-3656-v1.=
5.patch, YARN-3656-v1.patch, lowcostrayonexternal_v2.pdf
>
>
> YARN-1051 enables SLA support by allowing users to reserve cluster capaci=
ty ahead of time. YARN-1710 introduced a greedy agent for placing user rese=
rvations. The greedy agent makes fast placement decisions but at the cost o=
f ignoring the cluster committed resources, which might result in blocking =
the cluster resources for certain periods of time, and in turn rejecting so=
me arriving jobs.
> We propose LowCost =E2=80=93 a new cost-based planning algorithm. LowCost=
 =E2=80=9Cspreads=E2=80=9D the demand of the job throughout the allowed tim=
e-window according to a global, load-based cost function.=20


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)