hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8181) Upgrade JavaEWAH version to allow for unsorted bitset creation
Date Thu, 18 Sep 2014 18:43:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139317#comment-14139317
] 

Gopal V commented on HIVE-8181:
-------------------------------

This is the JavaEWAH change-set, that fixes the limitation (for like timestamp data with a
few off-order bits)

https://github.com/lemire/javaewah/commit/a6a52653b7118169f349b382ad2926608fdd656e

> Upgrade JavaEWAH version to allow for unsorted bitset creation
> --------------------------------------------------------------
>
>                 Key: HIVE-8181
>                 URL: https://issues.apache.org/jira/browse/HIVE-8181
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>            Reporter: Gopal V
>
> JavaEWAH has removed the restriction that bitsets can only be set in order in the latest
release. 
> Currently the use of {{ewah_bitmap}} UDAF requires a {{SORT BY}}.
> {code}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException:
Can't set bits out of order with EWAHCompressedBitmap
>         at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:824)
>         at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
>         at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
>         at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
>         at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
>         at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
>         at org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
>         at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
>         at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:249)
>         ... 7 more
> Caused by: java.lang.RuntimeException: Can't set bits out of order with EWAHCompressedBitmap
>         at 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message