hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lenin Raj <emaille...@gmail.com>
Subject Re: Able to ADD JAR but FileNotFoundException while querying
Date Sun, 02 Jun 2013 13:04:11 GMT
Hello All,

Bcc'ing Dev list

The PATH of the JAR file refers a HDFS path. Moved the file to HDFS and the
issue is resolved.

Though, ADD JAR command should valid whether file exists before saying
"Added resource"

Please correct me if I'm wrong.


Thanks,
Lenin


On Sun, Jun 2, 2013 at 4:09 PM, Lenin Raj <emaillenin@gmail.com> wrote:

> CC'ing the dev list.
>
>
> Thanks,
> Lenin
>
>
> On Sat, Jun 1, 2013 at 5:47 PM, Lenin Raj <emaillenin@gmail.com> wrote:
>
>> Hello,
>>
>> I created a 'tweets' table as mentioned here:
>> https://github.com/cloudera/cdh-twitter-example
>>
>> After populating data into HDFS directory, When I tried to query the
>> table, I am getting FileNotFoundException for the Hive serdes file.
>> ADD JAR command successfully works. But still throws that exception while
>> querying the table.
>>
>>
>> *hive> add jar
>> /usr/local/hive/hive/hive-serdes/hive-serdes-1.0-SNAPSHOT.jar;*
>> Added /usr/local/hive/hive/hive-serdes/hive-serdes-1.0-SNAPSHOT.jar to
>> class path
>> Added resource:
>> /usr/local/hive/hive/hive-serdes/hive-serdes-1.0-SNAPSHOT.jar
>> *hive> select count(*) from tweets;*
>> Total MapReduce jobs = 1
>> Launching Job 1 out of 1
>> Number of reduce tasks determined at compile time: 1
>> In order to change the average load for a reducer (in bytes):
>>   set hive.exec.reducers.bytes.per.reducer=<number>
>> In order to limit the maximum number of reducers:
>>   set hive.exec.reducers.max=<number>
>> In order to set a constant number of reducers:
>>   set mapred.reduce.tasks=<number>
>> *java.io.FileNotFoundException: File does not exist:
>> /usr/local/hive/hive/hive-serdes/hive-serdes-1.0-SNAPSHOT.jar
>> *        at
>> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:517)
>>         at
>> org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
>>         at
>> org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:707)
>>         at
>> org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
>>         at
>> org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
>>         at
>> org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
>>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
>>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:416)
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>>         at
>> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
>>         at
>> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
>>         at
>> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:447)
>>         at
>> org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:138)
>>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:144)
>>         at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1355)
>>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1139)
>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
>>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)
>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:616)
>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> Job Submission failed with exception 'java.io.FileNotFoundException(File
>> does not exist:
>> /usr/local/hive/hive/hive-serdes/hive-serdes-1.0-SNAPSHOT.jar)'
>> FAILED: Execution Error, return code 1 from
>> org.apache.hadoop.hive.ql.exec.MapRedTask
>> hive>
>>
>> Help is much appreciated.
>>
>> Thanks,
>> Lenin
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message