tajo-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hj...@apache.org
Subject [04/29] tajo git commit: TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa)
Date Fri, 05 Dec 2014 08:21:08 GMT
TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa)


Project: http://git-wip-us.apache.org/repos/asf/tajo/repo
Commit: http://git-wip-us.apache.org/repos/asf/tajo/commit/3ae44b1d
Tree: http://git-wip-us.apache.org/repos/asf/tajo/tree/3ae44b1d
Diff: http://git-wip-us.apache.org/repos/asf/tajo/diff/3ae44b1d

Branch: refs/heads/hbase_storage
Commit: 3ae44b1d2a1cf49123eb1d1c30f081a8a8d0e7fb
Parents: 3d485ec
Author: JaeHwa Jung <blrunner@apache.org>
Authored: Thu Nov 27 19:27:10 2014 +0900
Committer: JaeHwa Jung <blrunner@apache.org>
Committed: Thu Nov 27 19:27:10 2014 +0900

----------------------------------------------------------------------
 CHANGES                                            |  2 ++
 tajo-docs/src/main/sphinx/hcatalog_integration.rst | 13 +++++++++++++
 2 files changed, 15 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/tajo/blob/3ae44b1d/CHANGES
----------------------------------------------------------------------
diff --git a/CHANGES b/CHANGES
index 1657c20..f2141a6 100644
--- a/CHANGES
+++ b/CHANGES
@@ -13,6 +13,8 @@ Release 0.9.1 - unreleased
 
   IMPROVEMENT
 
+    TAJO-1053: ADD PARTITIONS for HCatalogStore. (jaehwa)
+
     TAJO-1195: Remove unused CachedDNSResolver Class. (DaeMyung Kang via jaehwa)
 
     TAJO-1184: Upgrade netty-buffer to 4.0.24.Final. (jinho)

http://git-wip-us.apache.org/repos/asf/tajo/blob/3ae44b1d/tajo-docs/src/main/sphinx/hcatalog_integration.rst
----------------------------------------------------------------------
diff --git a/tajo-docs/src/main/sphinx/hcatalog_integration.rst b/tajo-docs/src/main/sphinx/hcatalog_integration.rst
index 7337346..d81975d 100644
--- a/tajo-docs/src/main/sphinx/hcatalog_integration.rst
+++ b/tajo-docs/src/main/sphinx/hcatalog_integration.rst
@@ -37,3 +37,16 @@ Finally, you should specify HCatalogStore as Tajo catalog driver class
in ``conf
     <name>tajo.catalog.store.class</name>
     <value>org.apache.tajo.catalog.store.HCatalogStore</value>
   </property>
+
+.. note::
+
+  Hive stores a list of partitions for each table in its metastore. If new partitions are
+  directly added to HDFS, HiveMetastore will not able aware of these partitions unless the
user
+  ``ALTER TABLE table_name ADD PARTITION`` commands on each of the newly added partitions
or
+  ``MSCK REPAIR TABLE  table_name`` command.
+
+  But current tajo doesn't provide ``ADD PARTITION`` command and hive doesn't provide an
api for
+  responding to ``MSK REPAIR TABLE`` command. Thus, if you insert data to hive partitioned
+  table and you want to scan the updated partitions through Tajo, you must run following
command on hive ::
+
+  $ MSCK REPAIR TABLE [table_name];


Mime
View raw message