hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1500) Improve the way Counters are managed by JobTracker
Date Wed, 17 Feb 2010 18:14:27 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun C Murthy updated MAPREDUCE-1500:

    Assignee: Arun C Murthy

A short-term fix might be to intern the strings... of course, MAPREDUCE-901 will help a *lot*.

> Improve the way Counters are managed by JobTracker
> --------------------------------------------------
>                 Key: MAPREDUCE-1500
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1500
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>            Reporter: Amar Kamat
>            Assignee: Arun C Murthy
> Counters typically eat up a considerable amount of JobTracker's heap space. There is
also a considerable heap space wastage due to duplicate Strings in Counters. Some amount of
Counters' storage optimization can help reduce the load on JobTracker's memory.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message