hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-809) number of input lines it processed, number of output lines it produced for PIG job
Date Tue, 02 Jun 2009 21:51:07 GMT

    [ https://issues.apache.org/jira/browse/PIG-809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715709#action_12715709
] 

Alan Gates commented on PIG-809:
--------------------------------

Sorry, I referenced the wrong jira in the previous comment.  I meant PIG-626.

> number of input lines it processed, number of output lines it produced for PIG job
> ----------------------------------------------------------------------------------
>
>                 Key: PIG-809
>                 URL: https://issues.apache.org/jira/browse/PIG-809
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>         Environment: Linux
>            Reporter: Supreeth
>
> Excerpt from the mail conversation.
> It will be a great addition to Pig. Hadoop currently provides all these
> counters. All Pig has to do is to add them up for all Hadoop jobs in the
> script, and emit them at the end of the script. File a jira ?
> - Milind
> On 5/13/09 8:16 AM, "Supreeth Hosur Nagesh Rao" <supreeth@yahoo-inc.com>
> wrote:
> > > Hi Olga
> > > 
> > > With every PIG job is there any way for us to trap into the operational
> > > stats of that job, like number of input lines it processed, number of
> > > output lines it produced?
> > > 
> > > I dont want to have a separate PIG script to do the same as it may be
> > > additional parsing, so is there such a stat. If not can that be
> > > provided, and exposed as a config parameter?
> > > 
> > > -Supreeth
> This will be a great feature to have for our processing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message