hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-5876) Shuffling information logged to userlogs/attempt_####_###_r_###_#/syslogs
Date Wed, 20 May 2009 18:57:45 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Owen O'Malley resolved HADOOP-5876.
-----------------------------------

    Resolution: Won't Fix

I don't see any way to push the logging to the task tracker. The processing is done by the
task. You can grab the shuffle bytes from the counters.

> Shuffling information logged to userlogs/attempt_####_###_r_###_#/syslogs
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-5876
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5876
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.18.0, 0.18.1, 0.18.2, 0.18.3, 0.19.0, 0.19.1, 0.20.0
>         Environment: Redhat EL 5.1, Java 6
>            Reporter: Eric Yang
>            Priority: Critical
>
> Shuffling information is currently logged to userlogs, it would be ideal to have this
information consolidated in task tracker log or job history log file for down stream log collection
and analysis program (Chukwa) to pickup.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message