hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Pestritto <m...@pestritto.com>
Subject Error on Load into multiple Partitions
Date Wed, 15 Jul 2009 14:09:46 GMT
Hi All.

Are there are existing test cases that load into multiple partitions using a
single from query?  This query worked in an older revision but the mappers
fails when I run on trunk:

java.lang.RuntimeException: Map operator initialization failed
	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:176)
	at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:204)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:264)
	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:103)


Here is a simplified version of what I'm running and DDL to support:
*create table test_m ( client int, description string )
  row format delimited fields terminated by '\011' lines terminated by
'\012' stored as textfile;
*
*create table test_m_p ( description string )
  partitioned by ( client int ) row format delimited fields terminated by
'\011' lines terminated by '\012' stored as textfile;
*
*LOAD DATA LOCAL INPATH '/tmp/m.lst' OVERWRITE INTO TABLE test_m  ; *

*FROM test_m
INSERT OVERWRITE TABLE test_m_p PARTITION ( client=1 ) select description
where client=1
INSERT OVERWRITE TABLE test_m_p PARTITION ( client=2 ) select description
where client=2 ;
*
--- contents of /tmp/m.lst
1    test
1    test2
1    test3
2    hi
2    hi1
2    hi3

Thanks!
-Matt

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message