Return-Path: Delivered-To: apmail-incubator-pig-dev-archive@locus.apache.org Received: (qmail 81668 invoked from network); 27 Nov 2007 18:14:06 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 27 Nov 2007 18:14:06 -0000 Received: (qmail 72704 invoked by uid 500); 27 Nov 2007 18:13:54 -0000 Delivered-To: apmail-incubator-pig-dev-archive@incubator.apache.org Received: (qmail 72687 invoked by uid 500); 27 Nov 2007 18:13:54 -0000 Mailing-List: contact pig-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: pig-dev@incubator.apache.org Delivered-To: mailing list pig-dev@incubator.apache.org Received: (qmail 72669 invoked by uid 99); 27 Nov 2007 18:13:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Nov 2007 10:13:54 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Nov 2007 18:14:04 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 0F97B71422E for ; Tue, 27 Nov 2007 10:13:43 -0800 (PST) Message-ID: <11007266.1196187223038.JavaMail.jira@brutus> Date: Tue, 27 Nov 2007 10:13:43 -0800 (PST) From: "Olga Natkovich (JIRA)" To: pig-dev@incubator.apache.org Subject: [jira] Updated: (PIG-31) concurrent modification error In-Reply-To: <1958048.1196187103665.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-31?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-31: ------------------------------ Attachment: concurrentmod.patch please, review > concurrent modification error > ----------------------------- > > Key: PIG-31 > URL: https://issues.apache.org/jira/browse/PIG-31 > Project: Pig > Issue Type: Bug > Components: impl > Reporter: Olga Natkovich > Assignee: Olga Natkovich > Priority: Critical > Attachments: concurrentmod.patch > > > Many users encountered this problem. The stack looks like: > Error:java.lang.RuntimeException > at java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372) > at java.util.AbstractList$Itr.next(AbstractList.java:343) > at com.yahoo.pig.builtin.SUM.sum(SUM.java:58) > at com.yahoo.pig.builtin.SUM.exec(SUM.java:25) > at com.yahoo.pig.builtin.SUM.exec(SUM.java:21) > at com.yahoo.pig.impl.eval.FuncEvalSpec$1.add(FuncEvalSpec.java:101) > at com.yahoo.pig.impl.eval.GenerateSpec$CrossProductItem.(GenerateSpec.java:140) > at com.yahoo.pig.impl.eval.GenerateSpec$1.add(GenerateSpec.java:52) > at com.yahoo.pig.impl.eval.GenerateSpec$CrossProductItem.add(GenerateSpec.java:217) > at com.yahoo.pig.impl.eval.collector.UnflattenCollector.add(UnflattenCollector.java:42) > at com.yahoo.pig.impl.eval.collector.DataCollector.addToSuccessor(DataCollector.java:79) > at com.yahoo.pig.impl.eval.SimpleEvalSpec$1.add(SimpleEvalSpec.java:21) > at com.yahoo.pig.impl.eval.GenerateSpec$CrossProductItem.exec(GenerateSpec.java:248) > at com.yahoo.pig.impl.eval.GenerateSpec$1.add(GenerateSpec.java:61) > at com.yahoo.pig.impl.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:144) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:355) > at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1707) > We traced the issue to the same bag being shared between multiple operations and clearing it in one place caused problem in another. Will attach Ben's fix shortly. All unit and end-to-end tests passed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.