hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()
Date Fri, 30 Oct 2015 19:25:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14983126#comment-14983126
] 

Hudson commented on MAPREDUCE-6528:
-----------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #556 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/556/])
MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). (jlowe: rev 6344b6a7694c70f296392b6462dba452ff762109)
* hadoop-mapreduce-project/CHANGES.txt
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryFileManager.java


> Memory leak for HistoryFileManager.getJobSummary()
> --------------------------------------------------
>
>                 Key: MAPREDUCE-6528
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6528
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.7.2, 2.6.3
>
>         Attachments: MAPREDUCE-6528.patch
>
>
> We meet memory leak issues for JHS in a large cluster which is caused by code below doesn't
release FSDataInputStream in exception case. MAPREDUCE-6273 should fix most cases that exceptions
get thrown. However, we still need to fix the memory leak for occasional case.
> {code} 
> private String getJobSummary(FileContext fc, Path path) throws IOException {
>     Path qPath = fc.makeQualified(path);
>     FSDataInputStream in = fc.open(qPath);
>     String jobSummaryString = in.readUTF();
>     in.close();
>     return jobSummaryString;
>   }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message