hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From peterm_second <regest...@gmail.com>
Subject Hive on Tez Error
Date Fri, 21 Nov 2014 18:11:07 GMT
Hi Guys,
I am trying to enable tez on my hiveserver2 but everytime I get this error

Exception in thread "main" java.lang.RuntimeException: 
java.io.IOException: Previous writer likely failed to write 
hdfs://hadoop-nn.mo-data.com:9000/tmp/hive/root/_tez_session_dir/a0087fb2-1430-43fa-b3e1-06644ab4961d/*.

Failing because I am unlikely to write too.
     at 
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:457)
     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.io.IOException: Previous writer likely failed to write 
hdfs://hadoop-nn.mo-data.com:9000/tmp/hive/root/_tez_session_dir/a0087fb2-1430-43fa-b3e1-06644ab4961d/*.

Failing because I am unlikely to write too.
     at 
org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:974)
     at 
org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:855)
     at 
org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:798)
     at 
org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:228)
     at 
org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:154)
     at 
org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:122)
     at 
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:454)
     ... 7 more

I am a noob when it comes to tez and hive, has anyone seen this problem 
? Any ideas what might be causing it.
As far as I understand tez doesn't use the distributed cashe so it tries 
to localize all the resources for each session. I have no idea what 
process is holding those files and causing it to fail with this error.
I am using Hive 0.14.0 and tez 0.6

Regards,
Peter

Mime
View raw message