impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joe McDonnell (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-4623: Enable file handle cache
Date Thu, 11 May 2017 20:22:27 GMT
Joe McDonnell has posted comments on this change.

Change subject: IMPALA-4623: Enable file handle cache

Patch Set 4:

File be/src/exec/

Line 92:           tnode.hdfs_scan_node.parquet_mr_write_zone : ""),
> you can also initialize that inline in the .h file
Done, also did this for counters_running_
File be/src/runtime/disk-io-mgr-handle-cache.h:

Line 105
> no trailing _ for structs
File be/src/runtime/disk-io-mgr-handle-cache.h:

Line 116
> provide comments for variables, in particular invariants (e.g., it looks li
File be/src/runtime/disk-io-mgr-handle-cache.inline.h:

Line 33
> could these be null?
hdfs_file_ can be null when we fail to open the file (hdfsOpenFile returns null).
File be/src/runtime/disk-io-mgr-handle-cache.inline.h:

Line 61
> also: use something out of util/hash-util.h
File be/src/runtime/

Line 1309:   string key = string(fname) + ":" + std::to_string(mtime);
> probably a good idea, it's unlikely that we'll see a lot of overwritten fil
Changed this to hash the filename and then match the mtime on iterating.

To view, visit
To unsubscribe, visit

Gerrit-MessageType: comment
Gerrit-Change-Id: Ibe5ff60971dd653c3b6a0e13928cfa9fc59d078d
Gerrit-PatchSet: 4
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Joe McDonnell <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: Joe McDonnell <>
Gerrit-Reviewer: Marcel Kornacker <>
Gerrit-Reviewer: Tim Armstrong <>
Gerrit-HasComments: Yes

View raw message