hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Namit Jain <nj...@facebook.com>
Subject Re: Error on Load into multiple Partitions
Date Thu, 16 Jul 2009 14:09:43 GMT
Most probably, this is the same as


which was merged just a days back. Can you try on the latest trunk ?

On 7/16/09 6:45 AM, "Matt Pestritto" <matt@pestritto.com> wrote:

Does anyone have any idea as to the reason for this error ?

Thanks in Advance

---------- Forwarded message ----------
From: Matt Pestritto <matt@pestritto.com>
Date: Wed, Jul 15, 2009 at 10:09 AM
Subject: Error on Load into multiple Partitions
To: hive-dev@hadoop.apache.org

Hi All.

Are there are existing test cases that load into multiple partitions using a
single from query?  This query worked in an older revision but the mappers
fails when I run on trunk:

java.lang.RuntimeException: Map operator initialization failed

        at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
        at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)

Caused by: java.lang.NullPointerException
        at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:176)
        at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:204)

        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:264)
        at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:103)

Here is a simplified version of what I'm running and DDL to support:
*create table test_m ( client int, description string )
  row format delimited fields terminated by '\011' lines terminated by
'\012' stored as textfile;
*create table test_m_p ( description string )
  partitioned by ( client int ) row format delimited fields terminated by
'\011' lines terminated by '\012' stored as textfile;

*FROM test_m
INSERT OVERWRITE TABLE test_m_p PARTITION ( client=1 ) select description
where client=1
INSERT OVERWRITE TABLE test_m_p PARTITION ( client=2 ) select description
where client=2 ;
--- contents of /tmp/m.lst
1    test
1    test2
1    test3
2    hi
2    hi1
2    hi3


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message