hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs
Date Mon, 24 Oct 2011 20:30:32 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mahadev konar updated MAPREDUCE-2821:
-------------------------------------

    Attachment: MAPREDUCE-2821.patch

Tested patch with added test. Includes some fixing of javac warning/unwanted imports and some
indentation. I know should have filed another jira but couldnt keep myself from not doing
it. Also, the new history event is not serialized (didnt want to break rumen/others). This
should be fine except wehn the AM restarts when all the tasks are run and it just has to write
the summary logs. In that case the resources logged would be 0.
                
> [MR-279] Missing fields in job summary logs 
> --------------------------------------------
>
>                 Key: MAPREDUCE-2821
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2821
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramya Sunil
>            Assignee: Mahadev konar
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2821.patch, MAPREDUCE-2821.patch
>
>
> The following fields are missing in the job summary logs in mrv2:
> - numSlotsPerMap
> - numSlotsPerReduce
> - clusterCapacity (Earlier known as clusterMapCapacity and clusterReduceCapacity in 0.20.x)
> The first two fields are important to know if the job was a High RAM job or not and the
last field is important to know the total available resource in the cluster during job execution.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message