hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pengcheng Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15788) Implement FastBloomFilter to use RoaringBitmap instead of long[]
Date Sat, 25 Mar 2017 20:30:42 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941945#comment-15941945
] 

Pengcheng Xiong commented on HIVE-15788:
----------------------------------------

I am deferring this to Hive 3.0 as we are going to cut the first RC and it is not marked as
blocker. Please feel free to commit to the branch if this can be resolved before the release.

> Implement FastBloomFilter to use RoaringBitmap instead of long[] 
> -----------------------------------------------------------------
>
>                 Key: HIVE-15788
>                 URL: https://issues.apache.org/jira/browse/HIVE-15788
>             Project: Hive
>          Issue Type: Improvement
>          Components: UDF
>            Reporter: Gopal V
>
> Currently, a bloom filter which is all 1s occupies the exact amount of space as a bloom
filter which is sparse.
> This is an entire waste of space and produces memory pressure and generate a massive
number of cache misses.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message