hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis Ryu" <navis....@nexr.com>
Subject Review Request 29498: Upgrade JavaEWAH version to allow for unsorted bitset creation
Date Wed, 31 Dec 2014 00:52:15 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29498/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-8181
    https://issues.apache.org/jira/browse/HIVE-8181


Repository: hive-git


Description
-------

JavaEWAH has removed the restriction that bitsets can only be set in order in the latest release.


Currently the use of {{ewah_bitmap}} UDAF requires a {{SORT BY}}.

{code}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Can't
set bits out of order with EWAHCompressedBitmap
        at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:824)
        at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
        at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
        at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
        at org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
        at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
        at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:249)
        ... 7 more
Caused by: java.lang.RuntimeException: Can't set bits out of order with EWAHCompressedBitmap
        at 
{code}


Diffs
-----

  pom.xml 0e30078 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/AbstractGenericUDFEWAHBitmapBop.java 58ea3ba

  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFEWAHBitmap.java e4b412e 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java e3fb558 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEWAHBitmapAnd.java 7838b54 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEWAHBitmapEmpty.java 4a14a65

  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEWAHBitmapOr.java d438f82 
  ql/src/test/queries/clientpositive/index_bitmap2.q 89fbe76 
  ql/src/test/queries/clientpositive/udf_bitmap_empty.q 142b248 
  ql/src/test/results/clientpositive/index_bitmap2.q.out 73c5b90 
  ql/src/test/results/clientpositive/index_bitmap3.q.out 599bf3a 
  ql/src/test/results/clientpositive/index_bitmap_auto.q.out 81c1795 
  ql/src/test/results/clientpositive/udf_bitmap_and.q.out 8c93398 
  ql/src/test/results/clientpositive/udf_bitmap_empty.q.out ca96e78 
  ql/src/test/results/clientpositive/udf_bitmap_or.q.out 43521da 

Diff: https://reviews.apache.org/r/29498/diff/


Testing
-------


Thanks,

Navis Ryu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message