hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Pestritto <m...@pestritto.com>
Subject Fwd: Error on Load into multiple Partitions
Date Thu, 16 Jul 2009 13:45:42 GMT
Does anyone have any idea as to the reason for this error ?

Thanks in Advance
-Matt

---------- Forwarded message ----------
From: Matt Pestritto <matt@pestritto.com>
Date: Wed, Jul 15, 2009 at 10:09 AM
Subject: Error on Load into multiple Partitions
To: hive-dev@hadoop.apache.org


Hi All.

Are there are existing test cases that load into multiple partitions using a
single from query?  This query worked in an older revision but the mappers
fails when I run on trunk:

java.lang.RuntimeException: Map operator initialization failed

	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)

Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:176)
	at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:204)

	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:264)
	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:103)


Here is a simplified version of what I'm running and DDL to support:
*create table test_m ( client int, description string )
  row format delimited fields terminated by '\011' lines terminated by
'\012' stored as textfile;
*
*create table test_m_p ( description string )
  partitioned by ( client int ) row format delimited fields terminated by
'\011' lines terminated by '\012' stored as textfile;
*
*LOAD DATA LOCAL INPATH '/tmp/m.lst' OVERWRITE INTO TABLE test_m  ; *

*FROM test_m
INSERT OVERWRITE TABLE test_m_p PARTITION ( client=1 ) select description
where client=1
INSERT OVERWRITE TABLE test_m_p PARTITION ( client=2 ) select description
where client=2 ;
*
--- contents of /tmp/m.lst
1    test
1    test2
1    test3
2    hi
2    hi1
2    hi3

Thanks!
-Matt

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message