hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-232) Number of input/output rows in the logs is invalid with BinaryStorage
Date Thu, 08 May 2008 00:45:57 GMT

     [ https://issues.apache.org/jira/browse/PIG-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun C Murthy updated PIG-232:
------------------------------

    Attachment: PIG-232_1_20080507.patch

Patch to fix input-records as well...

> Number of input/output rows in the logs is invalid with BinaryStorage
> ---------------------------------------------------------------------
>
>                 Key: PIG-232
>                 URL: https://issues.apache.org/jira/browse/PIG-232
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Arun C Murthy
>         Attachments: PIG-232_0_20080507.patch, PIG-232_1_20080507.patch
>
>
> My pig script:
> define CMD `perl PigStreamingBad.pl end` ship('PigStreamingBad.pl') stderr('CMD' limit
1);
> A = load 'studenttab10k';
> B = stream A through CMD;
> store B into 'out';
> My perl script:
> use strict;
> # This script is used to test streaming error cases in pig.
> # Usage: PigStreaming.pl <start|middle|end>
> # the parameter tells the application when to exit with error
> if ($#ARGV < 0)
> {
>         print STDERR "Usage PigStreaming.pl <start|middle|end>\n";
>         exit (-1);
> }
> my $pos = $ARGV[0];
> if ($pos eq "start")
> {
>         print STDERR "Failed in the beginning of the processing\n";
>         exit(1);
> }
> print STDERR "PigStreamingBad.pl: starting processing\n";
> my $cnt = 0;
> while (<STDIN>)
> {
>         print "$_";
>         $cnt++;
>         print STDERR "PigStreaming.pl: processing $_\n";
>         if (($cnt > 100) && ($pos eq "middle"))
>         {
>                 print STDERR "Failed in the middle of processing\n";
>                 exit(2);
>         }
> }
> print STDERR "Failed at the end of processing\n";
> exit(3);

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message