hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Grover <grover.markgro...@gmail.com>
Subject Re: HIVE: java.lang.ArrayIndexOutOfBoundsException: 2 during JOIN
Date Tue, 15 Jan 2013 18:35:06 GMT
Fernando,
Could you share your table definitions as well please?

On Tue, Jan 15, 2013 at 10:31 AM, Fernando Andrés Doglio Turissini <
fernando.doglio@globant.com> wrote:

> Hello everyone, I'm struggling with an exception I'm getting on a
> particular query that's driving me crazy!
>
> Here is the exception I get:
>
> java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing writable org.apache.hadoop.hive.serde2.colum
> nar.BytesRefArrayWritable@71412b61
>         at
> org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:161)
>         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:441)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:377)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing writable
> org.apache.hadoop.hive.serde2.columnar.BytesRefArray
> Writable@71412b61
>         at
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:524)
>         at
> org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
>         ... 8 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
>         at
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:506)
>         ... 9 more
>
>
> Here is the query I'm running:
>
> INSERT INTO TABLE variance
> SELECT id, collect_set(name)[0], SUM( POW(age - age_mean, 2) ) / count(1)
> FROM age_mean join data_table on (age_mean.id = '01' AND data_table.q1 =
> 1)
> where age is not null and age_mean is not null GROUP BY id;
>
> It's probably relevant to mention that I'm doing this on an EMR cluster.
>
> Any idea what might be causing the exception?
>
> Thanks!
> Fernando
>

Mime
View raw message