pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (PIG-4068) ObjectCache cause ClassCastException
Date Thu, 24 Jul 2014 02:07:38 GMT

     [ https://issues.apache.org/jira/browse/PIG-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Cheolsoo Park resolved PIG-4068.
--------------------------------

    Resolution: Fixed

Committed to trunk. Thank you Daniel!

> ObjectCache cause ClassCastException
> ------------------------------------
>
>                 Key: PIG-4068
>                 URL: https://issues.apache.org/jira/browse/PIG-4068
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Cheolsoo Park
>            Assignee: Cheolsoo Park
>             Fix For: 0.14.0
>
>         Attachments: PIG-4068-1.patch
>
>
> Here is stack trace-
> {code}
> 2014-07-23 20:19:41,503 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Encounted
an error while executing task: attempt_1405989231017_0003_1_10_000087_2
> java.lang.ClassCastException: java.lang.Boolean cannot be cast to java.util.Map
>     at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.collectSample(PigProcessor.java:345)
>     at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.initializeInputs(PigProcessor.java:255)
>     at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.run(PigProcessor.java:183)
>     at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:315)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>     at java.lang.Thread.run(Thread.java:745)
> {code}
> The problem is that {{PigProcessor.collectSample()}} and {{POPartitionRearrangeTez.init()}}
use the same cache key for different objects (Map vs. Boolean)-
> {code:title=PigProcessor.java}
> String quantileMapCacheKey = "sample-" + sampleVertex  + ".cached";
> sampleMap = (Map<String, Object>)ObjectCache.getInstance().retrieve(quantileMapCacheKey);{code}
> {code:title=POPartitionRearrangeTez.java}
> String isCachedKey = "sample-" + PigProcessor.sampleVertex + ".cached";
> ...
> cache.cache(isCachedKey, Boolean.TRUE);
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message