impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Tauber-Marshall (Code Review)" <>
Subject [Impala-CR](cdh5-trunk) IMPALA-3629: Codegen TransferScratchTuples() in hdfs-parquet-scanner
Date Wed, 10 Aug 2016 17:49:45 GMT
Thomas Tauber-Marshall has posted comments on this change.

Change subject: IMPALA-3629: Codegen TransferScratchTuples() in hdfs-parquet-scanner

Patch Set 4:


I played around with a few different options for exactly what to cross compile/constants to
replace/etc, and while obviously its workload dependent, I think the best option for now is
to limit the cross compilation basically just to the inner loop of TransferScratchTuples,
as I've done here.
File be/src/exec/

Line 1: // Licensed to the Apache Software Foundation (ASF) under one
> We'll have to update the license header to the Apache one.
File be/src/exec/

PS3, Line 388:   // is non-recoverable, otherwise log the error and continue with the next
row group.
             :   while (true) {
> RETURN_IF_ERROR(node->runtime_state()->GetCodegen(&codegen));

PS3, Line 408: set + split_length)) {
             :       // A row group is processed by the scanner whose split overl
> codegen->GetIntConstant(sizeof(tuple_byte_size), tuple_byte_size) ?

PS3, Line 520: 
> long line.
File be/src/exec/hdfs-parquet-scanner.h:

Line 446: 
> Maybe document that these are arguments so that they can be replaced by cod
File be/src/exec/

Line 689:     if (fn == NULL || !s.ok() || !runtime_state()->codegen_enabled()) {
> It would be good to rework this so that:

To view, visit
To unsubscribe, visit

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic327e437c7cd2b3f92cdb11c1e907bfee2d44ee8
Gerrit-PatchSet: 4
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Thomas Tauber-Marshall <>
Gerrit-Reviewer: Michael Ho <>
Gerrit-Reviewer: Thomas Tauber-Marshall <>
Gerrit-Reviewer: Tim Armstrong <>
Gerrit-HasComments: Yes

View raw message