pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-4152) Enabling pig.exec.estimate.parallelism causes runtime exception in Tez
Date Wed, 03 Sep 2014 22:05:52 GMT

     [ https://issues.apache.org/jira/browse/PIG-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Cheolsoo Park updated PIG-4152:
-------------------------------
    Attachment: ip-10-237-184-159.ec2.internal_9103

Attaching a task log with the error. So vertexName is indeed null-
{code}
2014-09-03 19:12:30,766 INFO [TezChild] org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor:
Sending numParallelism 1 to null
2014-09-03 19:12:30,770 ERROR [TezChild] org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor:
Encountered exception while processing:
{code}

> Enabling pig.exec.estimate.parallelism causes runtime exception in Tez 
> -----------------------------------------------------------------------
>
>                 Key: PIG-4152
>                 URL: https://issues.apache.org/jira/browse/PIG-4152
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Cheolsoo Park
>             Fix For: 0.14.0
>
>         Attachments: ip-10-237-184-159.ec2.internal_9103
>
>
> I have a job that runs fine. But if I enable auto parallelism for sample job, it fails
with an error.
> {code}
> SET pig.exec.estimate.parallelism true;
> {code}
> Here is the stack trace-
> {code}
> 2014-09-03 19:17:18,060 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Encounted
an error while executing task: attempt_1409152864826_35896_1_00_000031_0
> java.lang.IllegalArgumentException
>     at com.google.common.base.Preconditions.checkArgument(Preconditions.java:72)
>     at org.apache.tez.runtime.api.events.VertexManagerEvent.<init>(VertexManagerEvent.java:49)
>     at org.apache.tez.runtime.api.events.VertexManagerEvent.create(VertexManagerEvent.java:61)
>     at org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.run(PigProcessor.java:231)
>     at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172)
>     at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>     at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message