pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2358) JobStats.getHadoopCounters() is never set and always returns null
Date Fri, 02 Dec 2011 19:49:40 GMT

     [ https://issues.apache.org/jira/browse/PIG-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-2358:
----------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Unit tests pass. test-patch:
     [exec] -1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     -1 release audit.  The applied patch generated 463 release audit warnings
(more than the trunk's current 456 warnings).

There is no new file added, ignore release audit warning.

Patch committed to both trunk and 0.10 branch.

Thanks Xuting!
                
> JobStats.getHadoopCounters() is never set and always returns null
> -----------------------------------------------------------------
>
>                 Key: PIG-2358
>                 URL: https://issues.apache.org/jira/browse/PIG-2358
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.10
>            Reporter: Vivek Padmanabhan
>            Assignee: xuting zhao
>             Fix For: 0.10
>
>         Attachments: PIG-2358-1.patch, PIG-2358.patch, TEST-org.apache.pig.test.TestPigRunner.txt
>
>
> The api  JobStats.getHadoopCounters() always returns null since the instance variable
returned from the method ("counters") is never set.
> {code}
> PigStats stats = PigRunner.run(args, null);
> PigStats.JobGraph jobGraph = stats.getJobGraph();
> 		
> for (JobStats jobStats :  jobGraph) {
>    Counters counters = jobStats.getHadoopCounters();
>    System.out.println(counters);// prints null
> }
> {code}
> But of course I can get individual counter information through the other APIs (getHdfsBytesWritten(),getMapInputRecords()
etc).
> I guess the change came in as part of PIG-1389 (the instance variable got replaced with
method local variable in JobStats.addCounters).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message