hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Connell, Chuck" <>
Subject RE: Limit to columns or nesting of Hive table?
Date Thu, 04 Oct 2012 16:08:47 GMT
Thanks. So is the nesting limit 10 now? Does your 2nd paragraph mean that this limit cannot
easily be raised?


-----Original Message-----
From: Edward Capriolo [] 
Sent: Thursday, October 04, 2012 11:57 AM
Subject: Re: Limit to columns or nesting of Hive table?

There is an open jira ticket on this. There is a hard coded limit but it could be raised with
some mostly minor code changes.

One of the bigger problems is that hive stores the definition of a column in JDBC "column"
and for some databases larger nested structs can case issues.


On Thu, Oct 4, 2012 at 11:48 AM, Connell, Chuck <> wrote:
> I am trying to create a large Hive table, with many columns and deeply 
> nested structs. It is failing with java.lang.ArrayIndexOutOfBoundsException:
> 10.
> Before I spend a lot of time debugging my table declaration, is there 
> some limit here I should know about? Max number of columns? Max depth 
> of struct nesting?
> Thanks,
> Chuck

View raw message