hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From D K <deepe...@gmail.com>
Subject Re: /usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-*.jar does not exist
Date Wed, 06 Aug 2014 11:31:20 GMT
This is likely due to the failure of resolution of
export
HIVE_AUX_JARS_PATH=/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-*.jar
in /etc/hive/conf/hive-env.sh

You should be able to fix this by modifying /etc/hive/conf/hive-env.sh to
set:
export
HIVE_AUX_JARS_PATH=/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core.jar



On Wed, Aug 6, 2014 at 4:16 AM, Paweł Michna <pmichna@gmail.com> wrote:

> Hello,
>
> I'm trying to run this hive benchmark:
> https://github.com/cartershanklin/hive-testbench.
>
> While running the tpcds-setup.sh script, I get the following error:
>
> java.io.FileNotFoundException: File file:/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-*.jar
does not exist
>         at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:511)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:724)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:501)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:397)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
>         at org.apache.hadoop.mapreduce.JobSubmitter.copyRemoteFiles(JobSubmitter.java:140)
>         at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:213)
>         at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:301)
>         at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:389)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
>         at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562)
>         at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
>         at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557)
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548)
>         at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:420)
>         at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:136)
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
>         at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
>         at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:72) Job Submission
failed with exception 'java.io.FileNotFoundException(File file:/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-*.jar
does not exist)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
>
>
>
> This fails after the following command:
>
> hive -i settings/load-partitioned.sql -f ddl-tpcds/bin_partitioned/store_sales.sql -d
DB=tpcds_bin_partitioned_orc_6 -d SOURCE=tpcds_text_6 -d BUCKETS=1 -d RETURN_BUCKETS=1 -d
FILE=orc
>
>
>
>
> The "missing" jar file exists:
>
>
> [user@host ~]$ ls -l /usr/lib/hive-hcatalog/share/hcatalog/
> total 664-rw-r--r-- 1 root root 468839 May 27 12:59 hive-hcatalog-core-0.13.0.2.1.2.1-471.jar
> lrwxrwxrwx 1 root root     41 Jun 30 15:57 hive-hcatalog-core.jar -> hive-hcatalog-core-0.13.0.2.1.2.1-471.jar-rw-r--r--
1 root root  81042 May 27 12:59 hive-hcatalog-pig-adapter-0.13.0.2.1.2.1-471.jar
> lrwxrwxrwx 1 root root     48 Jun 30 15:57 hive-hcatalog-pig-adapter.jar -> hive-hcatalog-pig-adapter-0.13.0.2.1.2.1-471.jar-rw-r--r--
1 root root  67890 May 27 12:59 hive-hcatalog-server-extensions-0.13.0.2.1.2.1-471.jar
> lrwxrwxrwx 1 root root     54 Jun 30 15:57 hive-hcatalog-server-extensions.jar ->
hive-hcatalog-server-extensions-0.13.0.2.1.2.1-471.jar-rw-r--r-- 1 root root  52552 May 27
12:59 hive-hcatalog-streaming-0.13.0.2.1.2.1-471.jar
> lrwxrwxrwx 1 root root     46 Jun 30 15:57 hive-hcatalog-streaming.jar -> hive-hcatalog-streaming-0.13.0.2.1.2.1-471.jar
> drwxr-xr-x 3 root root   4096 Jun 30 15:57 storage-handlers
>
>
>
>
> What am I doing wrong?
>
> Regards
> --
> Paweł Michna
>
> P.S. I've posted this question on Stackoverflow:
> http://stackoverflow.com/questions/25136075/usr-lib-hive-hcatalog-share-hcatalog-hive-hcatalog-core-jar-does-not-exist
> .
>

Mime
View raw message