Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 39FAF11159 for ; Thu, 24 Jul 2014 02:07:39 +0000 (UTC) Received: (qmail 26366 invoked by uid 500); 24 Jul 2014 02:07:38 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 26307 invoked by uid 500); 24 Jul 2014 02:07:38 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 26293 invoked by uid 500); 24 Jul 2014 02:07:38 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 26290 invoked by uid 99); 24 Jul 2014 02:07:38 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jul 2014 02:07:38 +0000 Date: Thu, 24 Jul 2014 02:07:38 +0000 (UTC) From: "Cheolsoo Park (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (PIG-4068) ObjectCache cause ClassCastException MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/PIG-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-4068. -------------------------------- Resolution: Fixed Committed to trunk. Thank you Daniel! > ObjectCache cause ClassCastException > ------------------------------------ > > Key: PIG-4068 > URL: https://issues.apache.org/jira/browse/PIG-4068 > Project: Pig > Issue Type: Sub-task > Components: tez > Reporter: Cheolsoo Park > Assignee: Cheolsoo Park > Fix For: 0.14.0 > > Attachments: PIG-4068-1.patch > > > Here is stack trace- > {code} > 2014-07-23 20:19:41,503 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Encounted an error while executing task: attempt_1405989231017_0003_1_10_000087_2 > java.lang.ClassCastException: java.lang.Boolean cannot be cast to java.util.Map > at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.collectSample(PigProcessor.java:345) > at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.initializeInputs(PigProcessor.java:255) > at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.run(PigProcessor.java:183) > at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:315) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > {code} > The problem is that {{PigProcessor.collectSample()}} and {{POPartitionRearrangeTez.init()}} use the same cache key for different objects (Map vs. Boolean)- > {code:title=PigProcessor.java} > String quantileMapCacheKey = "sample-" + sampleVertex + ".cached"; > sampleMap = (Map)ObjectCache.getInstance().retrieve(quantileMapCacheKey);{code} > {code:title=POPartitionRearrangeTez.java} > String isCachedKey = "sample-" + PigProcessor.sampleVertex + ".cached"; > ... > cache.cache(isCachedKey, Boolean.TRUE); > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)