hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Pestritto <m...@pestritto.com>
Subject Re: Error on Load into multiple Partitions
Date Thu, 16 Jul 2009 14:24:25 GMT
Namit.

I just Updated to revision 794686 and that worked.  It looks like Zheng
committed this patch in the afternoon and this failed for me earlier that
morning.  Bad luck on my timing but I'm happy it works now.

Thanks.
-Matt


On Thu, Jul 16, 2009 at 10:09 AM, Namit Jain <njain@facebook.com> wrote:

> Most probably, this is the same as
>
> https://issues.apache.org/jira/browse/HIVE-636
>
> which was merged just a days back. Can you try on the latest trunk ?
>
>
>
>
> On 7/16/09 6:45 AM, "Matt Pestritto" <matt@pestritto.com> wrote:
>
> Does anyone have any idea as to the reason for this error ?
>
> Thanks in Advance
> -Matt
>
> ---------- Forwarded message ----------
> From: Matt Pestritto <matt@pestritto.com>
> Date: Wed, Jul 15, 2009 at 10:09 AM
> Subject: Error on Load into multiple Partitions
> To: hive-dev@hadoop.apache.org
>
>
> Hi All.
>
> Are there are existing test cases that load into multiple partitions using
> a
> single from query?  This query worked in an older revision but the mappers
> fails when I run on trunk:
>
> java.lang.RuntimeException: Map operator initialization failed
>
>        at
> org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
>        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
>        at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
>
> Caused by: java.lang.NullPointerException
>        at
> org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:176)
>        at
> org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:204)
>
>        at
> org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:264)
>        at
> org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:103)
>
>
> Here is a simplified version of what I'm running and DDL to support:
> *create table test_m ( client int, description string )
>  row format delimited fields terminated by '\011' lines terminated by
> '\012' stored as textfile;
> *
> *create table test_m_p ( description string )
>  partitioned by ( client int ) row format delimited fields terminated by
> '\011' lines terminated by '\012' stored as textfile;
> *
> *LOAD DATA LOCAL INPATH '/tmp/m.lst' OVERWRITE INTO TABLE test_m  ; *
>
> *FROM test_m
> INSERT OVERWRITE TABLE test_m_p PARTITION ( client=1 ) select description
> where client=1
> INSERT OVERWRITE TABLE test_m_p PARTITION ( client=2 ) select description
> where client=2 ;
> *
> --- contents of /tmp/m.lst
> 1    test
> 1    test2
> 1    test3
> 2    hi
> 2    hi1
> 2    hi3
>
> Thanks!
> -Matt
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message