impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Quanlong Huang (Code Review)" <ger...@cloudera.org>
Subject [Impala-ASF-CR] IMPALA-10080: Skip loading HDFS cache pools for non-HDFS file systems
Date Thu, 13 Aug 2020 13:42:05 GMT
Quanlong Huang has uploaded this change for review. ( http://gerrit.cloudera.org:8080/16335


Change subject: IMPALA-10080: Skip loading HDFS cache pools for non-HDFS file systems
......................................................................

IMPALA-10080: Skip loading HDFS cache pools for non-HDFS file systems

In global invalidate metadata, we always load HDFS cache pools using the
CachePoolReader. Actually, it only works for HDFS file systems, not for
other systems like S3 or local, etc. We already handle this in
CatalogServiceCatalog#CatalogServiceCatalog(). This patch adds a check
in CatalogServiceCatalog#reset() to skip loading cache pools if it's not
a true HDFS file system.

Tests
- Ran tests on S3. Verified that the IllegalStateException doesn't
  exists anymore.

Change-Id: Ib243d349177e1b982b313dd6e87ecc2ef4dfc3d8
---
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
1 file changed, 10 insertions(+), 2 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/35/16335/1
-- 
To view, visit http://gerrit.cloudera.org:8080/16335
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ib243d349177e1b982b313dd6e87ecc2ef4dfc3d8
Gerrit-Change-Number: 16335
Gerrit-PatchSet: 1
Gerrit-Owner: Quanlong Huang <huangquanlong@gmail.com>

Mime
  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message