hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sumit Kumar <skbrnwl-...@yahoo.com>
Subject Running hive in embedded/standalone mode
Date Mon, 23 Dec 2013 07:14:24 GMT
Hi there!

I want to run hive (0.11) in embedded/standalone mode against hadoop 2 for running queries
for my unit tests. I started with something similar to [1] and then used the hack in [2] to
setup local hadoop for unit testing. Though simple queries like "create database ...." and
"drop table ..." work fine, when running a complex query involving my own implementations,
i get into errors like the following:

04:05:48,774  INFO main exec.ExecDriver - Executing: ./target/hadoop/bin/hadoop jar null
org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///testpath/target/test-example-1.0.jar 
-plan file:/tmp/foo/hive_2013-12-23_04-05-47_838_5177198435033083517/-local-10004/plan.xml  
-jobconffile file:/tmp/foo/hive_2013-12-23_04-05-47_838_5177198435033083517/-local-10003/jobconf.xml
Exception in thread "main" java.io.IOException: Error opening job jar: null04:05:49,362 ERROR
main exec.Task - Execution failed with exit status: 1
04:05:49,362 ERROR main exec.Task - Obtaining error information
04:05:49,362 ERROR main exec.Task - 
Task failed!
Task ID:
  Stage-1

Logs:


    at org.apache.hadoop.util.RunJar.main(RunJar.java:135)
Caused by: java.io.FileNotFoundException: null (No such file or directory)
    at java.util.zip.ZipFile.open(Native Method)
    at java.util.zip.ZipFile.<init>(ZipFile.java:215)
    at java.util.zip.ZipFile.<init>(ZipFile.java:145)
    at java.util.jar.JarFile.<init>(JarFile.java:153)
    at java.util.jar.JarFile.<init>(JarFile.java:90)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:133)
Execution failed with exit status: 1
Obtaining error information

Task failed!
Task ID:
  Stage-1

Logs:

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
04:05:49,363 ERROR main exec.ExecDriver - Execution failed with exit status: 1
04:05:49,372 ERROR main ql.Driver - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask


I'm not sure why the jar path is coming as null when hive determines to call the hadoop jar
command; i've tried to set the log level to ALL to capture more details around this but seem
stuck at this moment because of no extra details. Please note that hadoop 1 didn't require
me to do any hack like in [2] and the code works fine for me just like it does for implementation
in [1]. Any pointers on how to debug this would be very helpful. 

Thanking you in advance for any pointers,
-Sumit

[1] https://github.com/elasticsearch/elasticsearch-hadoop/blob/200912f1deb678d8e63e2e82dd47250559bbf2d8/src/test/java/org/elasticsearch/hadoop/integration/hive/HiveEmbeddedServer.java
[2] https://github.com/cloudera/access/blob/master/sentry-tests/pom.xml

Mime
View raw message