impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-5789: Add always false flag in bloom filter
Date Tue, 03 Oct 2017 23:32:29 GMT
Tim Armstrong has posted comments on this change. ( )

Change subject: IMPALA-5789: Add always_false flag in bloom filter

Patch Set 1:


Will wait for the new PS but had a couple of high-level bits of feedback first. It may be
worth looking at Thomas' patches if you haven't already to make sure your changes are compatible.
File be/src/exec/
PS1, Line 104:     if (FilterContext::HasAlwaysFalseInList(FilterStats::SPLITS_KEY,
Not sure if this is relevant but there is a known problem with filtering out splits with some
scanners: IMPALA-3804
File be/src/util/bloom-filter.h:
PS1, Line 106:     if (always_false_) return 0;
I think this change will mess up some accounting in RuntimeFilterBank.

My preference is to continue to allocate the memory when the BloomFilter is constructed instead
of allocating it lazily. It would waste memory in the always_false case but I think we can
live with that because it doesn't increase worst-case memory consumption.

To view, visit
To unsubscribe, visit

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: If680240a3cd4583fc97c3192177d86d9567c4f8d
Gerrit-Change-Number: 8170
Gerrit-PatchSet: 1
Gerrit-Owner: Tianyi Wang <>
Gerrit-Reviewer: Tim Armstrong <>
Gerrit-Comment-Date: Tue, 03 Oct 2017 23:32:29 +0000
Gerrit-HasComments: Yes

  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message