hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()
Date Mon, 17 Apr 2017 15:44:43 GMT

    [ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971232#comment-15971232

Hudson commented on YARN-3760:

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11591/])
YARN-3760. FSDataOutputStream leak in (junping_du: rev 9d9087a67ad599e678948d5c1036e51cb8cf5e3a)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/AggregatedLogFormat.java

> FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()
> ----------------------------------------------------------------
>                 Key: YARN-3760
>                 URL: https://issues.apache.org/jira/browse/YARN-3760
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.4.0
>            Reporter: Daryn Sharp
>            Assignee: Haibo Chen
>            Priority: Critical
>             Fix For: 2.8.1, 3.0.0-alpha3
>         Attachments: YARN-3760.00.patch, YARN-3760.01.patch, YARN-3760.02.patch
> The aggregated log file does not appear to be properly closed when writes fail.  This
leaves a lease renewer active in the NM that spams the NN with lease renewals.  If the token
is marked not to be cancelled, the renewals appear to continue until the token expires.  If
the token is cancelled, the periodic renew spam turns into a flood of failed connections until
the lease renewer gives up.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message