Return-Path: X-Original-To: apmail-tajo-commits-archive@minotaur.apache.org Delivered-To: apmail-tajo-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4767BC55B for ; Tue, 2 Dec 2014 03:56:35 +0000 (UTC) Received: (qmail 64191 invoked by uid 500); 2 Dec 2014 03:56:35 -0000 Delivered-To: apmail-tajo-commits-archive@tajo.apache.org Received: (qmail 64121 invoked by uid 500); 2 Dec 2014 03:56:35 -0000 Mailing-List: contact commits-help@tajo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tajo.apache.org Delivered-To: mailing list commits@tajo.apache.org Received: (qmail 63943 invoked by uid 99); 2 Dec 2014 03:56:34 -0000 Received: from tyr.zones.apache.org (HELO tyr.zones.apache.org) (140.211.11.114) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Dec 2014 03:56:34 +0000 Received: by tyr.zones.apache.org (Postfix, from userid 65534) id 6C39B9B5608; Tue, 2 Dec 2014 03:56:34 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: jihoonson@apache.org To: commits@tajo.apache.org Date: Tue, 02 Dec 2014 03:56:39 -0000 Message-Id: In-Reply-To: <2ffdcd4accbe47e0bde9a6e5f56b57ba@git.apache.org> References: <2ffdcd4accbe47e0bde9a6e5f56b57ba@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [06/14] tajo git commit: TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa) TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa) Project: http://git-wip-us.apache.org/repos/asf/tajo/repo Commit: http://git-wip-us.apache.org/repos/asf/tajo/commit/3ae44b1d Tree: http://git-wip-us.apache.org/repos/asf/tajo/tree/3ae44b1d Diff: http://git-wip-us.apache.org/repos/asf/tajo/diff/3ae44b1d Branch: refs/heads/index_support Commit: 3ae44b1d2a1cf49123eb1d1c30f081a8a8d0e7fb Parents: 3d485ec Author: JaeHwa Jung Authored: Thu Nov 27 19:27:10 2014 +0900 Committer: JaeHwa Jung Committed: Thu Nov 27 19:27:10 2014 +0900 ---------------------------------------------------------------------- CHANGES | 2 ++ tajo-docs/src/main/sphinx/hcatalog_integration.rst | 13 +++++++++++++ 2 files changed, 15 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/tajo/blob/3ae44b1d/CHANGES ---------------------------------------------------------------------- diff --git a/CHANGES b/CHANGES index 1657c20..f2141a6 100644 --- a/CHANGES +++ b/CHANGES @@ -13,6 +13,8 @@ Release 0.9.1 - unreleased IMPROVEMENT + TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa) + TAJO-1195: Remove unused CachedDNSResolver Class. (DaeMyung Kang via jaehwa) TAJO-1184: Upgrade netty-buffer to 4.0.24.Final. (jinho) http://git-wip-us.apache.org/repos/asf/tajo/blob/3ae44b1d/tajo-docs/src/main/sphinx/hcatalog_integration.rst ---------------------------------------------------------------------- diff --git a/tajo-docs/src/main/sphinx/hcatalog_integration.rst b/tajo-docs/src/main/sphinx/hcatalog_integration.rst index 7337346..d81975d 100644 --- a/tajo-docs/src/main/sphinx/hcatalog_integration.rst +++ b/tajo-docs/src/main/sphinx/hcatalog_integration.rst @@ -37,3 +37,16 @@ Finally, you should specify HCatalogStore as Tajo catalog driver class in ``conf tajo.catalog.store.class org.apache.tajo.catalog.store.HCatalogStore + +.. note:: + + Hive stores a list of partitions for each table in its metastore. If new partitions are + directly added to HDFS, HiveMetastore will not able aware of these partitions unless the user + ``ALTER TABLE table_name ADD PARTITION`` commands on each of the newly added partitions or + ``MSCK REPAIR TABLE table_name`` command. + + But current tajo doesn't provide ``ADD PARTITION`` command and hive doesn't provide an api for + responding to ``MSK REPAIR TABLE`` command. Thus, if you insert data to hive partitioned + table and you want to scan the updated partitions through Tajo, you must run following command on hive :: + + $ MSCK REPAIR TABLE [table_name];