hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shanyu zhao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-10840) Fix OutOfMemoryError caused by metrics system in Azure File System
Date Tue, 15 Jul 2014 21:00:06 GMT
shanyu zhao created HADOOP-10840:
------------------------------------

             Summary: Fix OutOfMemoryError caused by metrics system in Azure File System
                 Key: HADOOP-10840
                 URL: https://issues.apache.org/jira/browse/HADOOP-10840
             Project: Hadoop Common
          Issue Type: Bug
          Components: metrics
    Affects Versions: 2.4.1
            Reporter: shanyu zhao
            Assignee: shanyu zhao


In Hadoop 2.x the Hadoop File System framework changed and no cache is implemented (refer
to HADOOP-6356). This means for every WASB access, a new NativeAzureFileSystem is created,
along which a Metrics source created and added to MetricsSystemImpl. Over time the sources
accumulated, eating memory and causing Java OutOfMemoryError.

The fix is to utilize the unregisterSource() method added to MetricsSystem in HADOOP-10839.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message