hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <>
Subject [jira] [Created] (HIVE-18227) Tez parallel execution fail
Date Tue, 05 Dec 2017 22:47:01 GMT
Daniel Dai created HIVE-18227:

             Summary: Tez parallel execution fail
                 Key: HIVE-18227
             Project: Hive
          Issue Type: Bug
          Components: Tez
            Reporter: Daniel Dai
            Assignee: Daniel Dai

Running tez Dag in parallel within a session fail. Here is the test case:
set hive.exec.parallel=true;
set hive.merge.tezfiles=true;
set tez.grouping.max-size=100000;
set tez.grouping.min-size=10000;

from student
insert overwrite table student4 select *
insert overwrite table student5 select *
insert overwrite table student6 select *;

The merge task run in parallel and result the exception:
org.apache.tez.dag.api.TezException: App master already running a DAG
        at org.apache.tez.dag.api.client.DAGClientHandler.submitDAG(
        at org.apache.tez.dag.api.client.rpc.DAGClientAMProtocolBlockingPBServerImpl.submitDAG(
        at org.apache.tez.dag.api.client.rpc.DAGClientAMProtocolRPC$DAGClientAMProtocol$2.callBlockingMethod(
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$
        at org.apache.hadoop.ipc.RPC$
        at org.apache.hadoop.ipc.Server$Handler$
        at org.apache.hadoop.ipc.Server$Handler$
        at Method)
        at org.apache.hadoop.ipc.Server$

This message was sent by Atlassian JIRA

View raw message