hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Sichi <jsi...@fb.com>
Subject Re: Hive index exceptions
Date Tue, 14 Jun 2011 17:57:13 GMT
It's because you have ...index.io.HiveIndexInputFormat instead of ...index.HiveIndexInputFormat.

JVS

On Jun 14, 2011, at 5:41 AM, suyu xie wrote:

> 
> I created the hive index based on hive-0.7, the stataments are as follows:
> 
> create index ind_userid_txt on table users(userid)as 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler'
WITH DEFERRED REBUILD STORED AS RCFile;
> ALTER INDEX ind_userid_txt ON users REBUILD;
> set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
> insert overwrite directory "/tmp/index_result" select '_bucketname','_offset' from default__users_ind_userid_txt__
where userid=1;
> set hive.exec.index_file=/tmp/index_result; 
> set hive.input.format=org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat;
> 
> select * from users where userid=1; 
> 
> the exception as follows, pls explain why throw the following exceptions,thanks.
> 
> 11/06/14 10:06:55 INFO exec.MapRedTask: Number of reduce tasks is set to 0 since there's
no reduce operator
> 11/06/14 10:06:55 INFO exec.MapRedTask: Using org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
> at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:548)
> at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> 11/06/14 10:06:55 ERROR exec.MapRedTask: Exception: org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> 11/06/14 10:06:55 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> hive> isap-00:/home/liren/hive-0.7.0/bin # 
> 
>  		 	   		  


Mime
View raw message