hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Connell, Chuck" <Chuck.Conn...@nuance.com>
Subject RE: Limit to columns or nesting of Hive table?
Date Thu, 04 Oct 2012 16:08:47 GMT
Thanks. So is the nesting limit 10 now? Does your 2nd paragraph mean that this limit cannot
easily be raised?

Chuck

-----Original Message-----
From: Edward Capriolo [mailto:edlinuxguru@gmail.com] 
Sent: Thursday, October 04, 2012 11:57 AM
To: user@hive.apache.org
Subject: Re: Limit to columns or nesting of Hive table?

There is an open jira ticket on this. There is a hard coded limit but it could be raised with
some mostly minor code changes.

One of the bigger problems is that hive stores the definition of a column in JDBC "column"
and for some databases larger nested structs can case issues.

Edward

On Thu, Oct 4, 2012 at 11:48 AM, Connell, Chuck <Chuck.Connell@nuance.com> wrote:
> I am trying to create a large Hive table, with many columns and deeply 
> nested structs. It is failing with java.lang.ArrayIndexOutOfBoundsException:
> 10.
>
>
>
> Before I spend a lot of time debugging my table declaration, is there 
> some limit here I should know about? Max number of columns? Max depth 
> of struct nesting?
>
>
>
> Thanks,
>
> Chuck
>
>

Mime
View raw message