impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Apple (Code Review)" <ger...@cloudera.org>
Subject [Impala-CR](cdh5-trunk) IMPALA-2840: Don't store table location in partition location
Date Mon, 29 Feb 2016 23:14:41 GMT
Jim Apple has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/2355

Change subject: IMPALA-2840: Don't store table location in partition location
......................................................................

IMPALA-2840: Don't store table location in partition location

For a table with location "ABC", most partitions will have locations
like "ABC/DEF=2". The "ABC" part of the location does not need to be
stored in Catalog for each partition; we can compress it down to one
bit in the common case.

Change-Id: I8c67b6ce0f83de2f5277a528a9ce67e47d638adb
---
M be/src/runtime/descriptors.cc
M be/src/runtime/descriptors.h
M common/thrift/CatalogObjects.thrift
M fe/src/main/java/com/cloudera/impala/analysis/LoadDataStmt.java
M fe/src/main/java/com/cloudera/impala/catalog/HdfsPartition.java
M fe/src/main/java/com/cloudera/impala/catalog/HdfsTable.java
M fe/src/test/java/com/cloudera/impala/planner/PlannerTestBase.java
M tests/common/custom_cluster_test_suite.py
A tests/custom_cluster/test_catalog_mem_usage.py
9 files changed, 190 insertions(+), 37 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/55/2355/1
-- 
To view, visit http://gerrit.cloudera.org:8080/2355
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I8c67b6ce0f83de2f5277a528a9ce67e47d638adb
Gerrit-PatchSet: 1
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Jim Apple <jbapple@cloudera.com>

Mime
View raw message