Mailing-List: contact pig-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: pig-dev@incubator.apache.org
Message-ID: <1234633263.1211994584979.JavaMail.jira@brutus>
Date: Wed, 28 May 2008 10:09:44 -0700 (PDT)
From: "Alan Gates (JIRA)" <jira@apache.org>
To: pig-dev@incubator.apache.org
Subject: [jira] Commented: (PIG-250) Pig is broken with speculative
 execution
In-Reply-To: <881976409.1211935547243.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/PIG-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12600532#action_12600532 ] 

Alan Gates commented on PIG-250:
--------------------------------

+1

> Pig is broken with speculative execution
> ----------------------------------------
>
>                 Key: PIG-250
>                 URL: https://issues.apache.org/jira/browse/PIG-250
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>         Attachments: PIG-250.patch
>
>
> If I have speculative execution turned on, the following script fails:
> a = load 'studenttab20m' as (name, age, gpa);
> b = load 'votertab10k' as (name, age, registration, contributions);
> c = filter a by age < '50';
> d = filter b by age < '50';
> e = cogroup c by (name, age), d by (name, age) parallel 10;
> f = foreach e generate flatten(c), flatten(d) parallel 10;
> g = group f by registration parallel 10;
> h = foreach g generate group, SUM(f.d::contributions) parallel 10;
> i = order h by ($1, $0);
> store i into 'out';
> I traced this to the fact that the first MR job produces one or more empty outputs from the reducer. This happened on the reducers that happened to have second task running.
> I am not sure what the issue is and I am working with hadoop guys to investigate. Until this issue is resolved, I would like to trun speculative execution off.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.