tajo-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jihoon...@apache.org
Subject tajo git commit: TAJO-2028: Refining Hive Integration document including typo.
Date Wed, 06 Jan 2016 07:44:23 GMT
Repository: tajo
Updated Branches:
  refs/heads/branch-0.11.1 a49c1a660 -> 8e4b8b110


TAJO-2028: Refining Hive Integration document including typo.

Signed-off-by: Jihoon Son <jihoonson@apache.org>


Project: http://git-wip-us.apache.org/repos/asf/tajo/repo
Commit: http://git-wip-us.apache.org/repos/asf/tajo/commit/8e4b8b11
Tree: http://git-wip-us.apache.org/repos/asf/tajo/tree/8e4b8b11
Diff: http://git-wip-us.apache.org/repos/asf/tajo/diff/8e4b8b11

Branch: refs/heads/branch-0.11.1
Commit: 8e4b8b1102f477a8fd45ea08a6478b05414f011b
Parents: a49c1a6
Author: Jongyoung Park <eminency@gmail.com>
Authored: Wed Jan 6 16:44:07 2016 +0900
Committer: Jihoon Son <jihoonson@apache.org>
Committed: Wed Jan 6 16:44:19 2016 +0900

----------------------------------------------------------------------
 CHANGES                                        |  3 ++
 tajo-docs/src/main/sphinx/hive_integration.rst | 36 +++++++++++++--------
 2 files changed, 26 insertions(+), 13 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/tajo/blob/8e4b8b11/CHANGES
----------------------------------------------------------------------
diff --git a/CHANGES b/CHANGES
index f145ba9..5c453e4 100644
--- a/CHANGES
+++ b/CHANGES
@@ -81,6 +81,9 @@ Release 0.11.1 - unreleased
 
   TASKS
 
+    TAJO-2028: Refining Hive Integration document including typo.
+    (Jongyoung Park via jihoon)
+
     TAJO-2019: Replace manual array copy with System.arraycopy().
     (Contributed by Dongkyu Hwangbo, committed by jaehwa)
 

http://git-wip-us.apache.org/repos/asf/tajo/blob/8e4b8b11/tajo-docs/src/main/sphinx/hive_integration.rst
----------------------------------------------------------------------
diff --git a/tajo-docs/src/main/sphinx/hive_integration.rst b/tajo-docs/src/main/sphinx/hive_integration.rst
index 4c1d8d4..6262a02 100644
--- a/tajo-docs/src/main/sphinx/hive_integration.rst
+++ b/tajo-docs/src/main/sphinx/hive_integration.rst
@@ -1,6 +1,6 @@
-*************************************
+****************
 Hive Integration
-*************************************
+****************
 
 Apache Tajo™ catalog supports HiveCatalogStore to integrate with Apache Hive™.
 This integration allows Tajo to access all tables used in Apache Hive. 
@@ -12,16 +12,22 @@ and then add some configs into ``conf/tajo-env.sh`` and ``conf/catalog-site.xml`
 This section describes how to setup HiveMetaStore integration.
 This instruction would take no more than five minutes.
 
-You need to set your Hive home directory to the environment variable ``HIVE_HOME`` in conf/tajo-env.sh
as follows: ::
+You need to set your Hive home directory to the environment variable **HIVE_HOME** in ``conf/tajo-env.sh``
as follows:
+
+.. code-block:: sh
 
   export HIVE_HOME=/path/to/your/hive/directory
 
 If you need to use jdbc to connect HiveMetaStore, you have to prepare MySQL jdbc driver.
-Next, you should set the path of MySQL JDBC driver jar file to the environment variable HIVE_JDBC_DRIVER_DIR
in conf/tajo-env.sh as follows: ::
+Next, you should set the path of MySQL JDBC driver jar file to the environment variable **HIVE_JDBC_DRIVER_DIR**
in ``conf/tajo-env.sh`` as follows:
+
+.. code-block:: sh
 
-  export HIVE_JDBC_DRIVER_DIR==/path/to/your/mysql_jdbc_driver/mysql-connector-java-x.x.x-bin.jar
+  export HIVE_JDBC_DRIVER_DIR=/path/to/your/mysql_jdbc_driver/mysql-connector-java-x.x.x-bin.jar
 
-Finally, you should specify HiveCatalogStore as Tajo catalog driver class in ``conf/catalog-site.xml``
as follows: ::
+Finally, you should specify HiveCatalogStore as Tajo catalog driver class in ``conf/catalog-site.xml``
as follows:
+
+.. code-block:: xml
 
   <property>
     <name>tajo.catalog.store.class</name>
@@ -30,13 +36,17 @@ Finally, you should specify HiveCatalogStore as Tajo catalog driver class
in ``c
 
 .. note::
 
-  Hive stores a list of partitions for each table in its metastore. If new partitions are
-  directly added to HDFS, HiveMetastore will not able aware of these partitions unless the
user
+  Hive stores a list of partitions for each table in its metastore. When new partitions are
+  added directly to HDFS, HiveMetastore can't recognize these partitions until the user executes
   ``ALTER TABLE table_name ADD PARTITION`` commands on each of the newly added partitions
or
-  ``MSCK REPAIR TABLE  table_name`` command.
+  ``MSCK REPAIR TABLE table_name`` command.
+
+  But current Tajo doesn't provide ``ADD PARTITION`` command and Hive doesn't provide an
api for
+  responding to ``MSK REPAIR TABLE`` command. Thus, if you insert data to Hive partitioned
+  table and you want to scan the updated partitions through Tajo, you must run following
command on Hive
+  (see `Hive doc <https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE)>`_
+  for more details of the command):
 
-  But current tajo doesn't provide ``ADD PARTITION`` command and hive doesn't provide an
api for
-  responding to ``MSK REPAIR TABLE`` command. Thus, if you insert data to hive partitioned
-  table and you want to scan the updated partitions through Tajo, you must run following
command on hive ::
+  .. code-block:: sql
 
-  $ MSCK REPAIR TABLE [table_name];
+    MSCK REPAIR TABLE [table_name];


Mime
View raw message