hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9
Date Mon, 02 Nov 2015 23:28:28 GMT

    [ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986265#comment-14986265
] 

Vinod Kumar Vavilapalli commented on YARN-2014:
-----------------------------------------------

[~patwhitey2007] / [~jlowe], any ideas if this ever got fixed?

> Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9
> --------------------------------------------------------------------
>
>                 Key: YARN-2014
>                 URL: https://issues.apache.org/jira/browse/YARN-2014
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.4.0
>            Reporter: patrick white
>            Assignee: Jason Lowe
>
> Performance comparison benchmarks from 2.x against 0.23 shows AM scalability benchmark's
runtime is approximately 10% slower in 2.4.0. The trend is consistent across later releases
in both lines, latest release numbers are:
> 2.4.0.0     runtime 255.6 seconds (avg 5 passes)
> 0.23.9.12 runtime 230.4 seconds (avg 5 passes)
> Diff: -9.9% 
> AM Scalability test is essentially a sleep job that measures time to launch and complete
a large number of mappers.
> The diff is consistent and has been reproduced in both a larger (350 node, 100,000 mappers)
perf environment, as well as a small (10 node, 2,900 mappers) demo cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message