pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3913) Pig should use job's jobClient wherever possible (fixes local mode counters)
Date Mon, 19 May 2014 21:59:38 GMT

    [ https://issues.apache.org/jira/browse/PIG-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14002474#comment-14002474

Cheolsoo Park commented on PIG-3913:

+1. Let's commit this.

Btw, the patch needs to be rebased to trunk. In addition, {{hadoop23/HadoopShims.java}} has
unused imports. Please fix them when committing the patch.


> Pig should use job's jobClient wherever possible (fixes local mode counters)
> ----------------------------------------------------------------------------
>                 Key: PIG-3913
>                 URL: https://issues.apache.org/jira/browse/PIG-3913
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>             Fix For: 0.13.0
>         Attachments: PIG-3913-1.patch, PIG-3913-3.patch, PIG-3913-5.patch, PIG-3913-6.patch,
> MapreduceLauncher initializes a statsJobClient to poll counter information of jobs. This
works fine in mapreduce mode but it reports incorrect information in local (auto-local) mode.
Pig code should try to use org.apache.hadoop.mapred.jobcontrol.Job's getJobClient api to get
handle to jobClient wherever possible. statsJobClient (and wherever its references are passed)
should be deprecated.

This message was sent by Atlassian JIRA

View raw message