hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Templeton (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4795) ContainerMetrics drops records
Date Wed, 06 Apr 2016 14:20:25 GMT

     [ https://issues.apache.org/jira/browse/YARN-4795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Daniel Templeton updated YARN-4795:
    Attachment: YARN-4795.002.patch

Nice catch.  Here's a rebased patch that addresses the issues.

> ContainerMetrics drops records
> ------------------------------
>                 Key: YARN-4795
>                 URL: https://issues.apache.org/jira/browse/YARN-4795
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.9.0
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>         Attachments: YARN-4795.001.patch, YARN-4795.002.patch
> The metrics2 system was implemented to deal with persistent sources.  {{ContainerMetrics}}
is an ephemeral source, and so it causes problems.  Specifically, the {{ContainerMetrics}}
only reports metrics once after the container has been stopped.  This behavior is a problem
because the metrics2 system can ask sources for reports that will be quietly dropped by the
sinks that care.  (It's a metrics2 feature, not a bug.)  If that final report is silently
dropped, it's lost, because the {{ContainerMetrics}} won't report anything else ever anymore.

This message was sent by Atlassian JIRA

View raw message