hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4983) Job counters sometimes go down as tasks run without task failures
Date Thu, 15 Jan 2009 09:49:59 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amareshwari Sriramadasu updated HADOOP-4983:
--------------------------------------------

    Status: Patch Available  (was: Open)


I monitored 3 long running jobs with long running tasks, whose counters oscillate over the
run of the job, without the patch.  
And with patch applied the jobs had incrementing counters, they never went down.

test-patch result :
{noformat}
     [exec]
     [exec] -1 overall.
     [exec]
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec]
     [exec]     -1 tests included.  The patch doesn't appear to include any new or modified
tests.
     [exec]                         Please justify why no tests are needed for this patch.
     [exec]
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec]
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec]
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec]
     [exec]     +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
     [exec]
     [exec]
{noformat}
It is not easy to write a test-case for this.

All core and contrib unit tests passed on my machine.

The same patch applies to 0.19, 0.20 and trunk

> Job counters sometimes go down as tasks run without task failures
> -----------------------------------------------------------------
>
>                 Key: HADOOP-4983
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4983
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Owen O'Malley
>            Assignee: Amareshwari Sriramadasu
>            Priority: Critical
>             Fix For: 0.19.1
>
>         Attachments: patch-4983.txt
>
>
> As tasks run, the counters seem to back up and move forward again. They always seem to
be right when the task completes. I suspect this may have been introduced in HADOOP-2208.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message