hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan LeCompte <lecom...@gmail.com>
Subject Failures during map/reduce when running a hive query
Date Sun, 11 Oct 2009 23:01:55 GMT
Hello all,

My hive queries are returning back successfully, however if I did in the
map/reduce job that's running as a result of running the query, I see the
following errors in a lot of map tasks that get killed:

java.lang.RuntimeException: Map operator initialization failed
	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:110)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:83)
	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:83)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)
	at org.apache.hadoop.mapred.Child.main(Child.java:155)
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.initializeOp(GroupByOperator.java:207)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:316)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:353)
	at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:338)
	at org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:59)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:316)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:353)
	at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:338)
	at org.apache.hadoop.hive.ql.exec.Operator.initializeOp(Operator.java:324)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:316)
	at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:301)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:316)
	at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:82)

	... 7 more


The reducers also fail at times with similar exceptions/errors.

Is this expected, or do I have something misconfigured? I don't have the
hive distribution on all of my hadoop nodes, just the single node where I
run the queries. I am using 0.4-rc2.

Thanks,
Ryan

Mime
View raw message