hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15549) Upgrade to commons-configuration 2.1 regresses task CPU consumption
Date Thu, 21 Jun 2018 17:57:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519642#comment-16519642

Hudson commented on HADOOP-15549:

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14460 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14460/])
HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU (todd: rev 59de9679540f6d0edfb34cf9f88e52b51d94b4f4)
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsConfig.java

> Upgrade to commons-configuration 2.1 regresses task CPU consumption
> -------------------------------------------------------------------
>                 Key: HADOOP-15549
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15549
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: metrics
>    Affects Versions: 3.0.2
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Major
>             Fix For: 3.2.0
>         Attachments: hadoop-15549.txt
> HADOOP-13660 upgraded from commons-configuration 1.x to 2.x. commons-configuration is
used when parsing the metrics configuration properties file. The new builder API used in the
new version apparently makes use of a bunch of very bloated reflection and classloading nonsense
to achieve the same goal, and this results in a regression of >100ms of CPU time as measured
by a program which simply initializes DefaultMetricsSystem.
> This isn't a big deal for long-running daemons, but for MR tasks which might only run
a few seconds on poorly-tuned jobs, this can be noticeable.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message