Return-Path: X-Original-To: apmail-tajo-commits-archive@minotaur.apache.org Delivered-To: apmail-tajo-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E244F10936 for ; Fri, 5 Dec 2014 08:21:05 +0000 (UTC) Received: (qmail 71132 invoked by uid 500); 5 Dec 2014 08:21:05 -0000 Delivered-To: apmail-tajo-commits-archive@tajo.apache.org Received: (qmail 71047 invoked by uid 500); 5 Dec 2014 08:21:05 -0000 Mailing-List: contact commits-help@tajo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tajo.apache.org Delivered-To: mailing list commits@tajo.apache.org Received: (qmail 70951 invoked by uid 99); 5 Dec 2014 08:21:05 -0000 Received: from tyr.zones.apache.org (HELO tyr.zones.apache.org) (140.211.11.114) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Dec 2014 08:21:05 +0000 Received: by tyr.zones.apache.org (Postfix, from userid 65534) id 6E0728BD2A7; Fri, 5 Dec 2014 08:21:05 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: hjkim@apache.org To: commits@tajo.apache.org Date: Fri, 05 Dec 2014 08:21:08 -0000 Message-Id: <065145696da7479886d7192d4e500a51@git.apache.org> In-Reply-To: <2c4288f7ee154fccb0fe608cdb77c586@git.apache.org> References: <2c4288f7ee154fccb0fe608cdb77c586@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [04/29] tajo git commit: TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa) TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa) Project: http://git-wip-us.apache.org/repos/asf/tajo/repo Commit: http://git-wip-us.apache.org/repos/asf/tajo/commit/3ae44b1d Tree: http://git-wip-us.apache.org/repos/asf/tajo/tree/3ae44b1d Diff: http://git-wip-us.apache.org/repos/asf/tajo/diff/3ae44b1d Branch: refs/heads/hbase_storage Commit: 3ae44b1d2a1cf49123eb1d1c30f081a8a8d0e7fb Parents: 3d485ec Author: JaeHwa Jung Authored: Thu Nov 27 19:27:10 2014 +0900 Committer: JaeHwa Jung Committed: Thu Nov 27 19:27:10 2014 +0900 ---------------------------------------------------------------------- CHANGES | 2 ++ tajo-docs/src/main/sphinx/hcatalog_integration.rst | 13 +++++++++++++ 2 files changed, 15 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/tajo/blob/3ae44b1d/CHANGES ---------------------------------------------------------------------- diff --git a/CHANGES b/CHANGES index 1657c20..f2141a6 100644 --- a/CHANGES +++ b/CHANGES @@ -13,6 +13,8 @@ Release 0.9.1 - unreleased IMPROVEMENT + TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa) + TAJO-1195: Remove unused CachedDNSResolver Class. (DaeMyung Kang via jaehwa) TAJO-1184: Upgrade netty-buffer to 4.0.24.Final. (jinho) http://git-wip-us.apache.org/repos/asf/tajo/blob/3ae44b1d/tajo-docs/src/main/sphinx/hcatalog_integration.rst ---------------------------------------------------------------------- diff --git a/tajo-docs/src/main/sphinx/hcatalog_integration.rst b/tajo-docs/src/main/sphinx/hcatalog_integration.rst index 7337346..d81975d 100644 --- a/tajo-docs/src/main/sphinx/hcatalog_integration.rst +++ b/tajo-docs/src/main/sphinx/hcatalog_integration.rst @@ -37,3 +37,16 @@ Finally, you should specify HCatalogStore as Tajo catalog driver class in ``conf tajo.catalog.store.class org.apache.tajo.catalog.store.HCatalogStore + +.. note:: + + Hive stores a list of partitions for each table in its metastore. If new partitions are + directly added to HDFS, HiveMetastore will not able aware of these partitions unless the user + ``ALTER TABLE table_name ADD PARTITION`` commands on each of the newly added partitions or + ``MSCK REPAIR TABLE table_name`` command. + + But current tajo doesn't provide ``ADD PARTITION`` command and hive doesn't provide an api for + responding to ``MSK REPAIR TABLE`` command. Thus, if you insert data to hive partitioned + table and you want to scan the updated partitions through Tajo, you must run following command on hive :: + + $ MSCK REPAIR TABLE [table_name];