Return-Path: X-Original-To: apmail-tajo-commits-archive@minotaur.apache.org Delivered-To: apmail-tajo-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B248A17320 for ; Mon, 9 Mar 2015 02:35:35 +0000 (UTC) Received: (qmail 92694 invoked by uid 500); 9 Mar 2015 02:35:35 -0000 Delivered-To: apmail-tajo-commits-archive@tajo.apache.org Received: (qmail 92643 invoked by uid 500); 9 Mar 2015 02:35:35 -0000 Mailing-List: contact commits-help@tajo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tajo.apache.org Delivered-To: mailing list commits@tajo.apache.org Received: (qmail 92017 invoked by uid 99); 9 Mar 2015 02:35:35 -0000 Received: from eris.apache.org (HELO hades.apache.org) (140.211.11.105) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Mar 2015 02:35:35 +0000 Received: from hades.apache.org (localhost [127.0.0.1]) by hades.apache.org (ASF Mail Server at hades.apache.org) with ESMTP id 22429AC006E for ; Mon, 9 Mar 2015 02:35:35 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: svn commit: r1665114 [25/30] - in /tajo/site/docs: 0.10.0/ 0.10.0/_sources/ 0.10.0/_sources/backup_and_restore/ 0.10.0/_sources/configuration/ 0.10.0/_sources/functions/ 0.10.0/_sources/getting_started/ 0.10.0/_sources/index/ 0.10.0/_sources/partitioni... Date: Mon, 09 Mar 2015 02:35:30 -0000 To: commits@tajo.apache.org From: hyunsik@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20150309023535.22429AC006E@hades.apache.org> Added: tajo/site/docs/current/configuration/catalog-site-xml.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/configuration/catalog-site-xml.html?rev=1665114&view=auto ============================================================================== --- tajo/site/docs/current/configuration/catalog-site-xml.html (added) +++ tajo/site/docs/current/configuration/catalog-site-xml.html Mon Mar 9 02:35:26 2015 @@ -0,0 +1,263 @@ + + + + + + + + + + The catalog-site.xml File — Apache Tajo 0.8.0 documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + +
+ + + + + + +
+
+
+ +
+
+
+ +
+

The catalog-site.xml File¶

+
+ + +
+ +
+
+ +
+ +
+ + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file Modified: tajo/site/docs/current/configuration/catalog_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/configuration/catalog_configuration.html?rev=1665114&r1=1665113&r2=1665114&view=diff ============================================================================== --- tajo/site/docs/current/configuration/catalog_configuration.html (original) +++ tajo/site/docs/current/configuration/catalog_configuration.html Mon Mar 9 02:35:26 2015 @@ -30,7 +30,7 @@ - + @@ -61,11 +61,11 @@ +
  • Index (Experimental Feature) +
  • Backup and Restore
  • HCatalog Integration
    • +
  • HBase Integration +
  • Tajo JDBC Driver
    • How to get JDBC driver
    • Setting the CLASSPATH
      • @@ -231,62 +255,90 @@ tests.

      By default, Catalog server stores catalog data into /tmp/tajo-catalog-${username} directory. But, some operating systems may remove all contents in /tmp when booting up. In order to ensure persistent store of your catalog data, you need to set a proper location of derby directory.

      -
      -

      MySQLStore Configuration¶

      -

      In order to use MySQLStore, you need to create database and user on MySQL for Tajo.

      -
      mysql> create user 'tajo'@'localhost' identified by 'xxxxxx';
-Query OK, 0 rows affected (0.00 sec)
+
      
+
      MySQL/MariaDB/PostgreSQL/Oracle Configuration¶
      
+
      Tajo supports several database systems, including MySQL, MariaDB, PostgreSQL, and Oracle, as its catalog store.
+In order to use these systems, you first need to create a database and a user for Tajo.
+The following example shows the creation of a user and a database with MySQL.
      
+
      mysql> create user 'tajo'@'localhost' identified by 'xxxxxx';
+Query OK, 0 rows affected (0.00 sec)
 
-mysql> create database tajo;
-Query OK, 1 row affected (0.00 sec)
+mysql> create database tajo;
+Query OK, 1 row affected (0.00 sec)
 
-mysql> grant all on tajo.* to 'tajo'@'localhost';
-Query OK, 0 rows affected (0.01 sec)
+mysql> grant all on tajo.* to 'tajo'@'localhost';
+Query OK, 0 rows affected (0.01 sec)
 
      
 
      
-
      And then, you need to prepare MySQL JDBC driver on the machine which can be ran TajoMaster. If you do, you should set TAJO_CLASSPATH variable in conf/tajo-env.sh with it as follows:
      
-
      export TAJO_CLASSPATH=/usr/local/mysql/lib/mysql-connector-java-x.x.x.jar
+
      Second, you must install the proper JDBC driver on the TajoMaster node. And then, you need to set the TAJO_CLASSPATH variable in conf/tajo-env.sh as follows:
      
+
      (MySQL)
+$ export TAJO_CLASSPATH=/usr/local/mysql/lib/mysql-connector-java-x.x.x.jar
+
+(MariaDB)
+$ export TAJO_CLASSPATH=/usr/local/mariadb/lib/mariadb-java-client-x.x.x.jar
+
+(PostgreSQL)
+$ export TAJO_CLASSPATH=/usr/share/java/postgresql-jdbc4.jar
+
+(Oracle)
+$ export TAJO_CLASSPATH=/path/to/oracle/driver/ojdbc7.jar
 
      
 
      
-
      Or you just can copy jdbc driver into $TAJO_HOME/lib.
      
-
      Finally, you should add the following config to conf/catalog-site.xml :
      
+
      Alternatively, you can copy the jdbc driver into $TAJO_HOME/lib.
      
+
      Finally, you must add the following configurations to conf/catalog-site.xml :
      
 
      <property>
-  <name>tajo.catalog.store.class</name>
-  <value>org.apache.tajo.catalog.store.MySQLStore</value>
+  <name>tajo.catalog.connection.id</name>
+  <value><user name></value>
 </property>
 <property>
-  <name>tajo.catalog.jdbc.connection.id</name>
-  <value><mysql user name></value>
+  <name>tajo.catalog.connection.password</name>
+  <value><user password></value>
 </property>
+
+<!-- MySQL -->
 <property>
-  <name>tajo.catalog.jdbc.connection.password</name>
-  <value><mysql user password></value>
+  <name>tajo.catalog.store.class</name>
+  <value>org.apache.tajo.catalog.store.MySQLStore</value>
 </property>
 <property>
-  <name>tajo.catalog.jdbc.uri</name>
+  <name>tajo.catalog.uri</name>
   <value>jdbc:mysql://<mysql host name>:<mysql port>/<database name for tajo>?createDatabaseIfNotExist=true</value>
 </property>
-
      
-
      
-
      
-
      
-
      MariaDBStore Configuration¶
      
-
      All configurations for using MariaDBStore is compatible with MySQLStore except following:
      
-
      export TAJO_CLASSPATH=/usr/local/mariadb/lib/mariadb-java-client-x.x.x.jar
-
      
-
      
-
      <property>
+
+<!-- MariaDB -->
+<property>
   <name>tajo.catalog.store.class</name>
   <value>org.apache.tajo.catalog.store.MariaDBStore</value>
 </property>
 <property>
-  <name>tajo.catalog.jdbc.uri</name>
+  <name>tajo.catalog.uri</name>
   <value>jdbc:mariadb://<mariadb host name>:<mariadb port>/<database name for tajo>?createDatabaseIfNotExist=true</value>
 </property>
+
+<!-- PostgreSQL -->
+<property>
+  <name>tajo.catalog.store.class</name>
+  <value>org.apache.tajo.catalog.store.PostgreSQLStore</value>
+</property>
+<property>
+  <name>tajo.catalog.uri</name>
+  <value>jdbc:postgresql://<postgresql host name>:<postgresql port>/<database name for tajo>?createDatabaseIfNotExist=true</value>
+</property>
+
+<!-- Oracle -->
+<property>
+  <name>tajo.catalog.store.class</name>
+  <value>org.apache.tajo.catalog.store.OracleStore</value>
+</property>
+<property>
+  <name>tajo.catalog.uri</name>
+  <value>jdbc:oracle:thin:@//<oracle host name>:<oracle port>/<ServiceName for tajo database></value>
+</property>
 
      
 
      
+
      
 
      
-
      HCatalogStore Configuration¶
      
+
      HCatalogStore Configuration¶
      
 
      Tajo support HCatalogStore to integrate with hive. If you want to use HCatalogStore, you just do as follows.
      
 
      First, you must compile source code and get a binary archive as follows:
      
 
      $ git clone https://git-wip-us.apache.org/repos/asf/tajo.git tajo
@@ -312,7 +364,6 @@ Query OK, 0 rows
 
      
 
      
 
      
-
      
 
 
           
      
@@ -320,7 +371,7 @@ Query OK, 0 rows
   
     
 
      
 
      Note
      
-
      In default, TajoMaster listens on 127.0.0.1 for clients. To allow remote clients to access TajoMaster, please set tajo.master.client-rpc.address config to tajo-site.xml. In order to know how to change the listen port, please refer Configuration Defaults.
      
+
      In default, TajoMaster listens on 127.0.0.1 for clients. To allow remote clients to access TajoMaster, please set tajo.master.client-rpc.address config to tajo-site.xml. In order to know how to change the listen port, please refer Cluster Service Configuration Defaults.
      Modified: tajo/site/docs/current/configuration/ha_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/configuration/ha_configuration.html?rev=1665114&r1=1665113&r2=1665114&view=diff ============================================================================== --- tajo/site/docs/current/configuration/ha_configuration.html (original) +++ tajo/site/docs/current/configuration/ha_configuration.html Mon Mar 9 02:35:26 2015 @@ -30,8 +30,8 @@ - - + + @@ -74,8 +74,9 @@
    • Tajo Master Configuration
    • Worker Configuration
    • Catalog Configuration
      • -
    • Configuration Defaults
    • High Availability for TajoMaster
      • +
    • The tajo-site.xml File
      • +
    • The catalog-site.xml File
  • Tajo Shell (TSQL)
    • +
  • Time Zone +
  • Functions
  • Table Management @@ -300,10 +310,10 @@ host2.domain.com Modified: tajo/site/docs/current/configuration/preliminary.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/configuration/preliminary.html?rev=1665114&r1=1665113&r2=1665114&view=diff ============================================================================== --- tajo/site/docs/current/configuration/preliminary.html (original) +++ tajo/site/docs/current/configuration/preliminary.html Mon Mar 9 02:35:26 2015 @@ -74,8 +74,9 @@
  • Tajo Master Configuration
  • Worker Configuration
  • Catalog Configuration
    • -
  • Configuration Defaults
  • High Availability for TajoMaster
    • +
  • The tajo-site.xml File
    • +
  • The catalog-site.xml File
  • Tajo Shell (TSQL)
    • +
  • Time Zone +
  • Functions
  • Table Management Added: tajo/site/docs/current/configuration/service_config_default.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/configuration/service_config_default.html?rev=1665114&view=auto ============================================================================== --- tajo/site/docs/current/configuration/service_config_default.html (added) +++ tajo/site/docs/current/configuration/service_config_default.html Mon Mar 9 02:35:26 2015 @@ -0,0 +1,315 @@ + + + + + + + + + + Cluster Service Configuration Defaults — Apache Tajo 0.8.0 documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    + + + + +
    + + + + + + +
    +
    +
    + +
    +
    +
    + +
    +

    Cluster Service Configuration Defaults¶

    +
    +

    Tajo Master Configuration Defaults¶

    + ++++++ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    Service NameConfig Property NameDescriptiondefault address
    Tajo Master Umbilical Rpctajo.master.umbilical-rpc.address localhost:26001
    Tajo Master Client Rpctajo.master.client-rpc.address localhost:26002
    Tajo Master Info Httptajo.master.info-http.address 0.0.0.0:26080
    Tajo Resource Tracker Rpctajo.resource-tracker.rpc.address localhost:26003
    Tajo Catalog Client Rpctajo.catalog.client-rpc.address localhost:26005
    +
    +

    Tajo Worker Configuration Defaults¶

    + ++++++ + + + + + + + + + + + + + + + + + + + + + + + + +
    Service NameConfig Property NameDescriptiondefault address
    Tajo Worker Peer Rpctajo.worker.peer-rpc.address 0.0.0.0:28091
    Tajo Worker Client Rpctajo.worker.client-rpc.address 0.0.0.0:28092
    Tajo Worker Info Httptajo.worker.info-http.address 0.0.0.0:28080
    +
    +
    +
    + + +
    + +
    +
    + +
    + +
    + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file Added: tajo/site/docs/current/configuration/service_config_defaults.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/configuration/service_config_defaults.html?rev=1665114&view=auto ============================================================================== --- tajo/site/docs/current/configuration/service_config_defaults.html (added) +++ tajo/site/docs/current/configuration/service_config_defaults.html Mon Mar 9 02:35:26 2015 @@ -0,0 +1,343 @@ + + + + + + + + + + Cluster Service Configuration Defaults — Apache Tajo 0.8.0 documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    + + + + +
    + + + + + + +
    +
    +
    + +
    +
    +
    + +
    +

    Cluster Service Configuration Defaults¶

    +
    +

    Tajo Master Configuration Defaults¶

    + ++++++ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    Service NameConfig Property NameDescriptiondefault address
    Tajo Master Umbilical Rpctajo.master.umbilical-rpc.address localhost:26001
    Tajo Master Client Rpctajo.master.client-rpc.address localhost:26002
    Tajo Master Info Httptajo.master.info-http.address 0.0.0.0:26080
    Tajo Resource Tracker Rpctajo.resource-tracker.rpc.address localhost:26003
    Tajo Catalog Client Rpctajo.catalog.client-rpc.address localhost:26005
    +
    +

    Tajo Worker Configuration Defaults¶

    + ++++++ + + + + + + + + + + + + + + + + + + + + + + + + +
    Service NameConfig Property NameDescriptiondefault address
    Tajo Worker Peer Rpctajo.worker.peer-rpc.address 0.0.0.0:28091
    Tajo Worker Client Rpctajo.worker.client-rpc.address 0.0.0.0:28092
    Tajo Worker Info Httptajo.worker.info-http.address 0.0.0.0:28080
    +
    +
    +
    + + +
    + +
    +
    + +
    + +
    + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file