asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luo Chen (Code Review)" <>
Subject Change in asterixdb[master]: [ASTERIXDB-2186][STO] Cache-friendly Bloom Filter
Date Wed, 06 Dec 2017 17:01:15 GMT
Luo Chen has posted comments on this change.

Change subject: [ASTERIXDB-2186][STO] Cache-friendly Bloom Filter

Patch Set 2:


Thanks for the comments!
File hyracks-fullstack/hyracks/hyracks-storage-am-bloomfilter/src/main/java/org/apache/hyracks/storage/am/bloomfilter/impls/

PS2, Line 45: 
            :     private static final int DEFAULT_BLOOM_FILTER_VERSION = 0;
            :     private static final int BLOCKED_BLOOM_FILTER_VERSION = 1;
> Interesting, why's this different than the existing storage version? And ho
The old bloom filter didn't store this version information. And because of the initialization
of buffer, the version is automatically 0...But right now we store it as 1.

PS2, Line 142: 
             :         boolean unpinWhenExit = false;
> Why this and pagesPinned? Why're they different?
I want to expose an API (pinAllPages) to the caller such that a query can pin all pages at
the beginning, and then call contains, and finally call unpinAllPages. Since bloom filter
is very small, this avoids the overhead of pin/unpin pages every time during a contains call
(which leads to another cache miss...)

However, if the query didn't call pinAllPages initially, it still works as before.

PS2, Line 247: throw HyracksDataException.create(ErrorCode.CANNOT_DEACTIVATE_PINNED_BLOOM_FILTER);
> Why is this the case, that it can't be evicted? Won't this possibly interfe
pinAllPages/unpinAllPages should be called by the query (e.g., a lot of pk lookups after search
secondary index). If a bloom filter is being used by a query, it would be a bad idea to evict
it's pages...

To view, visit
To unsubscribe, visit

Gerrit-MessageType: comment
Gerrit-Change-Id: I0e8e0db9b60d5addfaf61ebb372a1bcb2d2d5957
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Luo Chen <>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Ian Maxon <>
Gerrit-Reviewer: Jenkins <>
Gerrit-Reviewer: Luo Chen <>
Gerrit-HasComments: Yes

View raw message