impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Taras Bobrovytsky (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-4883: Union Codegen
Date Sat, 08 Apr 2017 02:47:21 GMT
Taras Bobrovytsky has posted comments on this change.

Change subject: IMPALA-4883: Union Codegen

Patch Set 6:

File be/src/exec/

PS6, Line 29: dst_batch->tuple_data_pool()
> is this where that mem-pool in the class is used when codegening?  Why not 
File be/src/exec/

Line 98: 
> Extra blank lines.

PS6, Line 113: abort codegen entirely.
> this doesn't seem to match the code. wouldn't we have already filled in cod
Reprased. Added a test case.

Line 235:     if (ReachedLimit()) {
> I don't think this can be taken now, right? Since we don't increment num_ro
Removed completely. I considered adding some extra logic to calculate if we reached the limit
and the child can be closed, but I decided not to (to reduce complexity and it makes the code
uglier for this special case). Let me know if you disagree with this decision.

Basically as a result of this, if we hit the limit, the child will be closed in UnionNode.Close()
instead of here.
File be/src/exec/union-node.h:

PS6, Line 68: Temporarily stores references to materialized tuples by a codegened function
> i'm not sure what this means. MemPools don't store references, they contain
Rewrote the comment. Also changed it so that mem-pool is used by the non-codegen version as

PS6, Line 71: TODO: Remove this when no longer necessary in the future.
> do we have a concrete jira for when this won't be necessary?
I couldn't find one, but I think Michael knows more about this.

PS6, Line 96: Jitted
> usually we say "codegen'ed"

I wrote it like this because I saw it written like that in other files such as (partitioned-aggregation-node.h).

Line 116:   /// call on the child.
> Maybe mention that these GetNext* functions don't apply the limit?
Done. I wasn't really sure where to put the comment, so I put it at the top.

PS6, Line 127:  Increments 'num_rows_returned_' and
             :   /// 'child_row_idx_'
> I think this needs an update.

To view, visit
To unsubscribe, visit

Gerrit-MessageType: comment
Gerrit-Change-Id: Ib4107d27582ff5416172810364a6e76d3d93c439
Gerrit-PatchSet: 6
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Taras Bobrovytsky <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: Michael Ho <>
Gerrit-Reviewer: Taras Bobrovytsky <>
Gerrit-Reviewer: Tim Armstrong <>
Gerrit-HasComments: Yes

View raw message