hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-6490) Path.normalize should use StringUtils.replace in favor of String.replace
Date Wed, 12 Oct 2011 11:37:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125724#comment-13125724

Hudson commented on HADOOP-6490:

Integrated in Hadoop-Hdfs-trunk-Commit #1139 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1139/])
    Move the HADOOP-6490 Changes note to the right section. Accidentally placed it under Bugs
in r1182189.

harsh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1182217
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

> Path.normalize should use StringUtils.replace in favor of String.replace
> ------------------------------------------------------------------------
>                 Key: HADOOP-6490
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6490
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.20.1
>            Reporter: Zheng Shao
>            Assignee: Uma Maheswara Rao G
>            Priority: Minor
>              Labels: newbie
>             Fix For: 0.24.0
>         Attachments: HADOOP-6490.patch
> in our environment, we are seeing that the JobClient is going out of memory because Path.normalizePath(String)
is called several tens of thousands of times, and each time it calls "String.replace" twice.
> java.lang.String.replace compiles a regex to do the job which is very costly.
> We should use org.apache.commons.lang.StringUtils.replace which is much faster and consumes
almost no extra memory.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message