hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "r7raul1984@163.com" <r7raul1...@163.com>
Subject hive -e run tez query error
Date Tue, 23 Jun 2015 05:53:47 GMT
When I use hive 1.1.0 on tez 0.53 in hadoop 2.3.0:

hive -v -e "set hive.execution.engine=tez;set mapred.job.queue.name=bi_etl;drop table TESTTMP.a_start;create
table TESTTMP.a_start(id bigint);insert overwrite table TESTTMP.a_start select id from tandem.p_city;drop
table TESTTMP.a_end;create table TESTTMP.a_end(id bigint);insert overwrite table TESTTMP.a_end
select id from TESTTMP.a_start;" 

Logging initialized using configuration in jar:file:/usr/local/src/apache-hive/lib/hive-common-1.1.0.jar!/hive-log4j.properties

SLF4J: Class path contains multiple SLF4J bindings. 
SLF4J: Found binding in [jar:file:/usr/local/src/apache-hive/lib/hive-jdbc-1.1.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 
set hive.execution.engine=tez 
set mapred.job.queue.name=bi_etl 
drop table TESTTMP.a_start 
OK 
Time taken: 1.702 seconds 
create table TESTTMP.a_start(id bigint) 
OK 
Time taken: 0.311 seconds 
insert overwrite table TESTTMP.a_start select id from tandem.p_city 
Query ID = lujian_20150623134848_31ba3183-74b8-4c3a-96ae-5c8b650b99df 
Total jobs = 1 
Launching Job 1 out of 1 


Status: Running (Executing on YARN cluster with App id application_1433219182593_252390) 

-------------------------------------------------------------------------------- 
VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED 
-------------------------------------------------------------------------------- 
Map 1 .......... SUCCEEDED 1 1 0 0 0 0 
-------------------------------------------------------------------------------- 
VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 13.55 s 
-------------------------------------------------------------------------------- 
Loading data to table testtmp.a_start 
Moved: 'hdfs://yhd-jqhadoop2.int.yihaodian.com:8020/user/hive/warehouse/testtmp.db/a_start/000000_0'
to trash at: hdfs://yhd-jqhadoop2.int.yihaodian.com:8020/user/lujian/.Trash/Current 
Table testtmp.a_start stats: [numFiles=1, numRows=531, totalSize=2154, rawDataSize=1623] 
OK 
Time taken: 25.586 seconds 
drop table TESTTMP.a_end 
OK 
Time taken: 0.232 seconds 
create table TESTTMP.a_end(id bigint) 
OK 
Time taken: 0.068 seconds 
insert overwrite table TESTTMP.a_end select id from TESTTMP.a_start 
Query ID = lujian_20150623134949_bff735c9-6abc-47e7-a9f7-f7e2be7e43e9 
Total jobs = 1 
Launching Job 1 out of 1 


Status: Running (Executing on YARN cluster with App id application_1433219182593_252390) 

-------------------------------------------------------------------------------- 
VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED 
-------------------------------------------------------------------------------- 
Map 1 FAILED 1 0 0 1 4 0 
-------------------------------------------------------------------------------- 
VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 15.46 s 
-------------------------------------------------------------------------------- 
Status: Failed 
Vertex failed, vertexName=Map 1, vertexId=vertex_1433219182593_252390_2_00, diagnostics=[Task
failed, taskId=task_1433219182593_252390_2_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Container
container_1433219182593_252390_01_000003 finished with diagnostics set to [Container failed.
File does not exist: hdfs://yhd-jqhadoop2.int.yihaodian.com:8020/user/lujian/lujian/_tez_session_dir/63de23a2-1cff-4434-96ad-1304089fb489/.tez/application_1433219182593_252390/tez-conf.pb

]], TaskAttempt 1 failed, info=[Container container_1433219182593_252390_01_000004 finished
with diagnostics set to [Container failed. File does not exist: hdfs://yhd-jqhadoop2.int.yihaodian.com:8020/user/lujian/lujian/_tez_session_dir/63de23a2-1cff-4434-96ad-1304089fb489/.tez/application_1433219182593_252390/tez-conf.pb

]], TaskAttempt 2 failed, info=[Container container_1433219182593_252390_01_000005 finished
with diagnostics set to [Container failed. File does not exist: hdfs://yhd-jqhadoop2.int.yihaodian.com:8020/user/lujian/lujian/_tez_session_dir/63de23a2-1cff-4434-96ad-1304089fb489/.tez/application_1433219182593_252390/tez-conf.pb

]], TaskAttempt 3 failed, info=[Container container_1433219182593_252390_01_000006 finished
with diagnostics set to [Container failed. File does not exist: hdfs://yhd-jqhadoop2.int.yihaodian.com:8020/user/lujian/lujian/_tez_session_dir/63de23a2-1cff-4434-96ad-1304089fb489/.tez/application_1433219182593_252390/tez-conf.pb

]]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex vertex_1433219182593_252390_2_00
[Map 1] killed/failed due to:null] 
DAG failed due to vertex failure. failedVertices:1 killedVertices:0 
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask

use hivecli to execute same query  ,no exception throw.
use hive -e  to execute same query on mr ,no exeception throw  





r7raul1984@163.com
Mime
View raw message