impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharath Vissapragada (Code Review)" <ger...@cloudera.org>
Subject [Impala-ASF-CR] IMPALA-4172/IMPALA-3653: Improvements to block metadata loading
Date Wed, 30 Nov 2016 06:10:32 GMT
Bharath Vissapragada has posted comments on this change.

Change subject: IMPALA-4172/IMPALA-3653: Improvements to block metadata loading
......................................................................


Patch Set 12:

(7 comments)

http://gerrit.cloudera.org:8080/#/c/5148/12//COMMIT_MSG
Commit Message:

Line 15: We loop throuh each and every file in the table/partition directories
> through
Done


Line 17: This results in large no. of RPC calls to namenode, especially with
> no. -> number
Done


Line 35: 
> mention the behavior change of REFRESH
Done


http://gerrit.cloudera.org:8080/#/c/5148/12/fe/src/main/java/org/apache/impala/catalog/DiskIdMapper.java
File fe/src/main/java/org/apache/impala/catalog/DiskIdMapper.java:

Line 31:  * - To maintain consistent mapping across all the table instances so that the disk
thread
> ... a consistent mapping ... so that the assignment of scan ranges to I/O t
Done


http://gerrit.cloudera.org:8080/#/c/5148/12/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
File fe/src/main/java/org/apache/impala/catalog/HdfsTable.java:

Line 288:    * Queries the filesystem to load the file block metadata (e.g. DFS blocks) for
the
> Suggest rephrasing:
Done


Line 296:    *   and enumerate all its blocks and their corresponding hosts and disk IDs.
> remove part about disk ids, I think that's the next point
Done


Line 778:     LOG.debug("partsByPath size: " + partsByPath.size());
> check log lvl
Done


-- 
To view, visit http://gerrit.cloudera.org:8080/5148
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie127658172e6e70dae441374530674a4ac9d5d26
Gerrit-PatchSet: 12
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Bharath Vissapragada <bharathv@cloudera.com>
Gerrit-Reviewer: Alex Behm <alex.behm@cloudera.com>
Gerrit-Reviewer: Bharath Vissapragada <bharathv@cloudera.com>
Gerrit-Reviewer: Mostafa Mokhtar <mmokhtar@cloudera.com>
Gerrit-HasComments: Yes

Mime
View raw message