hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lars Francke <lars.fran...@gmail.com>
Subject Re: Problem with the windowing function ntile (Exceptions)
Date Thu, 25 Jul 2013 06:10:05 GMT
We're still being bitten by this problem without a workaround. Does
anyone have an idea?

Thanks,
Lars

On Wed, Jul 17, 2013 at 11:24 PM, Lars Francke <lars.francke@gmail.com> wrote:
> Hi,
>
> I'm running a query like this:
>
> CREATE TABLE foo
>   STORED AS ORC
> AS
> SELECT
>   id,
>   season,
>   amount,
>   ntile(10)
> OVER (
>   PARTITION BY season
>   ORDER BY amount DESC
> )
> FROM bar;
>
> On a small enough dataset that works fine but when switching to a
> larger sample we're seeing exceptions like this:
>
> "Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Reset on
> PersistentByteBasedList not supported"
>
> Looking at the code (without really understanding it) we tried setting:
> SET hive.ptf.partition.persistence='org.apache.hadoop.hive.ql.exec.PTFPersistence$PartitionedByteBasedList';
>
> because that List supports reset but we are seeing a
> ClassNotFoundException so we're doing that wrong.
>
> Next try was setting hive.ptf.partition.persistence.memsize higher
> which worked but first of all we don't really understand what all of
> that stuff is doing and second of all we fear that it just might break
> down again.
>
> Any hints as to what that error really means and how to deal with it
> would be greatly appreciated.
>
> Thanks!
>
> Lars

Mime
View raw message