Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 24F6D200CB7 for ; Thu, 15 Jun 2017 20:13:15 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 238E6160BDF; Thu, 15 Jun 2017 18:13:15 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A1DFE160BED for ; Thu, 15 Jun 2017 20:13:12 +0200 (CEST) Received: (qmail 56750 invoked by uid 500); 15 Jun 2017 18:13:11 -0000 Mailing-List: contact commits-help@trafodion.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: commits@trafodion.apache.org Delivered-To: mailing list commits@trafodion.apache.org Received: (qmail 56725 invoked by uid 99); 15 Jun 2017 18:13:10 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jun 2017 18:13:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 0FF69C0787 for ; Thu, 15 Jun 2017 18:13:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.221 X-Spam-Level: X-Spam-Status: No, score=-4.221 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 5kCvECy7zPm5 for ; Thu, 15 Jun 2017 18:12:53 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id A4BE25F6CD for ; Thu, 15 Jun 2017 18:12:50 +0000 (UTC) Received: (qmail 54565 invoked by uid 99); 15 Jun 2017 18:12:49 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jun 2017 18:12:49 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id BC587E00EF; Thu, 15 Jun 2017 18:12:48 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: svarnau@apache.org To: commits@trafodion.incubator.apache.org Date: Thu, 15 Jun 2017 18:12:53 -0000 Message-Id: <1cf8d8b3a3204909963fa11e4d083cd1@git.apache.org> In-Reply-To: <99d338ea38084575bd0563533cc31fcb@git.apache.org> References: <99d338ea38084575bd0563533cc31fcb@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [06/32] incubator-trafodion-site git commit: 2.1 branch docs update archived-at: Thu, 15 Jun 2017 18:13:15 -0000 http://git-wip-us.apache.org/repos/asf/incubator-trafodion-site/blob/07e54414/docs/2.1.0/provisioning_guide/index.html ---------------------------------------------------------------------- diff --git a/docs/2.1.0/provisioning_guide/index.html b/docs/2.1.0/provisioning_guide/index.html index ba0ad17..aed1821 100644 --- a/docs/2.1.0/provisioning_guide/index.html +++ b/docs/2.1.0/provisioning_guide/index.html @@ -553,14 +553,12 @@ table.CodeRay td.code>pre{padding:0}
  • 2. Quick Start
  • -
  • 4.4. Required Configuration Changes +
  • 4.4. Recommended Configuration Changes -
  • -
  • 4.5. Recommended Configuration Changes -
  • @@ -636,72 +626,75 @@ table.CodeRay td.code>pre{padding:0}
  • 5.9. Download Trafodion Binaries
  • -
  • 5.10. Preparation for Recipe-Based Provisioning + +
  • +
  • 6. Install with Ambari +
  • -
  • 6. Install +
  • 7. Install
  • -
  • 7. Upgrade +
  • 8. Upgrade
  • -
  • 8. Activate +
  • 9. Activate
  • -
  • 9. Remove +
  • 10. Remove
  • -
  • 10. Enable Security +
  • 11. Enable Security
  • -
  • 11. Install Recipe
  • -
  • 12. Upgrade Recipe
  • @@ -747,7 +740,7 @@ it does indicate that the project has yet to be fully endorsed by the ASF.

    2.1.0

    -

    TBD

    +

    May 1, 2017

    2.0.1

    @@ -842,7 +835,7 @@ regardless of platform type.

    1.2. New and Changed Information

    -

    This guide has been updated to include provisioning for LDAP and Kerberos.

    +

    This guide has been updated to include Ambari installation.

    @@ -1043,7 +1036,8 @@ needs. Send any errors found, suggestions for improvement, or compliments to 2. Quick Start

    You need the following before using the information herein:

    @@ -1103,50 +1097,48 @@ You can download and install the Trafodion Clients once you’ve installed a

    Example

    +
    +

    Download the Trafodion Installer and Server binaries:

    +
    $ mkdir $HOME/trafodion-download
     $ cd $HOME/trafodion-download
     $ # Download the Trafodion Installer binaries
    -$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-1.3.0.incubating/apache-trafodion-installer-1.3.0-incubating-bin.tar.gz
    +$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-2.1.0.incubating/apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz
     Resolving http://apache.cs.utah.edu... 192.168.1.56
     Connecting to http://apache.cs.utah.edu|192.168.1.56|:80... connected.
     HTTP request sent, awaiting response... 200 OK
     Length: 68813 (67K) [application/x-gzip]
    -Saving to: "apache-trafodion-installer-1.3.0-incubating-bin.tar.gz"
    +Saving to: "apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz"
     
     100%[=====================================================================================================================>] 68,813       124K/s   in 0.5s
     
    -2016-02-14 04:19:42 (124 KB/s) - "apache-trafodion-installer-1.3.0-incubating-bin.tar.gz" saved [68813/68813]
    -
    -
    -
    -
    -
    -
    $ # Download the Trafodion Server binaries
    -$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-1.3.0.incubating/apache-trafodion-1.3.0-incubating-bin.tar.gz
    +2016-02-14 04:19:42 (124 KB/s) - "apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz" saved [68813/68813]
    +
    +$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-2.1.0.incubating/apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz
     Resolving http://apache.cs.utah.edu... 192.168.1.56
     Connecting to http://apache.cs.utah.edu|192.168.1.56|:80... connected.
     HTTP request sent, awaiting response... 200 OK
     Length: 214508243 (205M) [application/x-gzip]
    -Saving to: "apache-trafodion-1.3.0-incubating-bin.tar.gz"
    +Saving to: "apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz"
     
     100%[=====================================================================================================================>] 214,508,243 3.90M/s   in 55s
     
    -2016-02-14 04:22:14 (3.72 MB/s) - "apache-trafodion-1.3.0-incubating-bin.tar.gz" saved [214508243/214508243]
    +2016-02-14 04:22:14 (3.72 MB/s) - "apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz" saved [214508243/214508243]
     
     $ ls -l
    -total 209552
    --rw-rw-r-- 1 centos centos 214508243 Jan 12 20:10 apache-trafodion-1.3.0-incubating-bin.tar.gz
    --rw-rw-r-- 1 centos centos     68813 Jan 12 20:10 apache-trafodion-installer-1.3.0-incubating-bin.tar.gz
    +-rw-rw-r--. 1 centos centos     74237 Feb 13 14:53 apache-trafodion_pyinstaller-2.1.0-incubating.tar.gz
    +-rw-rw-r--. 1 centos centos 183114066 Feb 10 22:34 apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz
     $
    -

    2.2. Unpack Installer

    +

    2.2. Unpack Installer and Server package

    -

    The first step in the installation process is to unpack the Trafodion Installer tar file.

    +

    The first step in the installation process is to unpack the Trafodion Installer tar file. +Trafodion server package tar file can be auto detected by installer if put it in installer’s folder.

    Example

    @@ -1155,13 +1147,11 @@ $
    $ mkdir $HOME/trafodion-installer
     $ cd $HOME/trafodion-downloads
    -$ tar -zxf apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -C $HOME/trafodion-installer
    -$ ls $HOME/trafodion-installer/installer
    -bashrc_default           tools                             traf_config_check           trafodion_apache_hadoop_install  traf_package_setup
    -build-version-1.3.0.txt  traf_add_user                     traf_config_setup           trafodion_config_default         traf_setup
    -dcs_installer            traf_apache_hadoop_config_setup   traf_create_systemdefaults  trafodion_install                traf_sqconfig
    -rest_installer           traf_authentication_conf_default  traf_getHadoopNodes         trafodion_license                traf_start
    -setup_known_hosts.exp    traf_cloudera_mods98              traf_hortonworks_mods98     trafodion_uninstaller
    +$ tar -zxf apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz -C $HOME/trafodion-installer
    +$ cp -f apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz $HOME/trafodion-installer
    +$ ls $HOME/trafodion-installer/python-installer
    +apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz  db_install.py    DISCLAIMER    LICENSE  prettytable.py  scripts
    +configs                                                    db_uninstall.py  discovery.py  NOTICE   README.md
     $
    @@ -1172,23 +1162,22 @@ $

    Collect/decide the following information:

    -

    2.3.1. Location of Trafodion Server-Side Binary

    +

    2.3.1. Java Location

    -

    You need the fully-qualified name of the Trafodion server-side binary.

    +

    Java location can be automatically detected by installer. You need to provide the java location only if installer cannot detect it.

    -

    Example

    +

    How to detect java location manually:

    -
    -
    -
    /home/trafodion-downloads/apache-trafodion-installer-1.3.0-incubating-bin.tar.gz
    -
    -
    -
    -
    -

    2.3.2. Java Location

    -
    -

    You need to record the location of the Java. For example, use ps -ef | grep java | grep hadoop | grep hbase to determine what version HBase is running.

    +
    +
      +
    1. +

      Login to trafodion' node

      +
    2. +
    3. +

      Use ps -ef | grep java | grep hadoop | grep hbase to determine what version HBase is running.

      +
    4. +

    Example

    @@ -1205,9 +1194,12 @@ hbase 17302 17288 1 20:35 ? 00:00:10 /usr/jdk64/jdk1.7.0_67/bin/jav
    -

    2.3.3. Data Nodes

    +

    2.3.2. Data Nodes

    +
    +

    Trafodion is installed on all data nodes in your Hadoop cluster. Data nodes can be automatically detected by installer while installing on a HDP/CDH cluster.

    +
    -

    {projet-name} is installed on all data nodes in your Hadoop cluster. You need to record the fully-qualified domain name node for each node. +

    You need to record hostname for each node when you install Trafodion on Apache Hadoop. For example, refer to /etc/hosts.

    @@ -1219,34 +1211,16 @@ For example, refer to /etc/hosts.

    127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 -172.31.56.238 ip-172-31-56-238.ec2.internal node01 -172.31.61.110 ip-172-31-61-110.ec2.internal node02 -172.31.57.143 ip-172-31-57-143.ec2.internal node03 +172.31.56.238 node-1.internal node-1 +172.31.61.110 node-2.internal node-2
    -

    Record the node names in a space-separated list.

    -
    -
    -

    Example

    -
    -
    -
    -
    ip-172-31-56-238.ec2.internal ip-172-31-61-110.ec2.internal ip-172-31-57-143.ec2.internal
    -
    -
    -
    -
    -

    2.3.4. Trafodion Runtime User Home Directory

    -
    -

    The Installer creates the trafodion user ID. You need to decide the home directory for this user.

    -
    -
    -

    The default is: /home

    +

    Record the node names in a comma-separated list node-1, node-2 or in regular expression mode node-[1-2]

    -

    2.3.5. Distribution Manager URL

    +

    2.3.3. Distribution Manager URL

    The Installer interacts with the Distribution Manager (for example, Apache Ambari or Cloudera Manager) to modify the Hadoop configuration.

    @@ -1272,431 +1246,7 @@ Hadoop configuration.

    Collect Information above.

    -

    The following example shows a guided install of Trafodion on a three-node Hortonworks Hadoop cluster.

    -
    -
    - - - - - -
    - - -By default, the Trafodion Installer invokes sqlci so that you can enter the initialize trafodion; command. -This is shown in the example below. -
    -
    -
    -

    Example

    -
    -
    -
      -
    1. -

      Run the Trafodion Installer in guided mode.

      -
      -
      -
      $ cd $HOME/trafodion-installer/installer
      -$ ./trafodion_install 2>&1 | tee install.log
      -******************************
      - TRAFODION INSTALLATION START
      -******************************
      -
      -***INFO: testing sudo access
      -***INFO: Log file located at /var/log/trafodion/trafodion_install_2016-06-30-21-02-38.log
      -***INFO: Config directory: /etc/trafodion
      -***INFO: Working directory: /usr/lib/trafodion
      -
      -************************************
      - Trafodion Configuration File Setup
      -************************************
      -
      -***INFO: Please press [Enter] to select defaults.
      -
      -Is this a cloud environment (Y/N), default is [N]: N
      -Enter trafodion password, default is [traf123]:
      -Enter list of data nodes (blank separated), default []: ip-172-31-56-238.ec2.internal ip-172-31-61-110.ec2.internal ip-172-31-57-143.ec2.internal
      -Do you h ave a set of management nodes (Y/N), default is N: N
      -Enter Trafodion userid's home directory prefix, default is [/home]: /opt
      -Specify  location of Java 1.7.0_65 or higher (JDK), default is []: /usr/jdk64/jdk1.7.0_67
      -Enter full path (including .tar or .tar.gz) of trafodion tar file []: /home/trafodion-downloads/apache-trafodion_server-2.0.1-incubating.tar.gz
      -Enter Backup/Restore username (can be Trafodion), default is [trafodion]:
      -Specify the Hadoop distribut ion installed (1: Cloudera, 2: Hortonworks, 3: Other): 2
      -Enter Hadoop admin username, default is [admin]: Enter Hadoop admin pas sword, default is [admin]:
      -Enter full Hadoop external network URL:port (include 'http://' or 'https://), default is []: http://ip-172-31-56-238.ec2.internal:8080
      -Enter  HDFS username or username running HDFS, default is [hdfs]:
      -Enter HBase username or username running HBase, default is [hbase]:
      -Enter HBase group, default is [hbase]:
      -Enter Zookeeper username or username running Zookeeper, default is [zookeeper]:
      -Enter  directory to install trafodion to, default is [/opt/trafodion/apache-trafodion_server-2.0.1-incubating]:
      -Start Trafodion after install (Y/N), default is Y:
      -Total number of client connections per cluster, default [24]: 96
      -Enter the node of primary DcsMaste r, default [ip-172-31-56-238.ec2.internal]:
      -Enable High Availability (Y/N), default is N:
      -Enable simple LDAP security (Y/N), d efault is N:
      -***INFO: Trafodion configuration setup complete
      -***INFO: Trafodion Configuration File Check
      -***INFO: Testing sudo access on node ip-172-31-56-238
      -***INFO: Testing sudo access on node ip-172-31-61-110
      -***INFO: Testing sudo access on node ip-172-31-57-143
      -***INFO: Testing ssh on ip-172-31-56-238
      -***INFO: Testing ssh on ip-172-31-61-110
      -***INFO: Testing ssh on ip-172-31-57-143
      -#!/bin/bash
      -#
      -# @@@ START COPYRIGHT @@@
      -#
      -# Licensed to the Apache Software Foundation (ASF) under one
      -# or more contributor license agreements.  See the NOTICE file
      -# distributed with this work for additional information
      -# regarding copyright ownership.  The ASF licenses this file
      -# to you under the Apache License, Version 2.0 (the
      -# "License"); you may not use this file except in compliance
      -# with the License.  You may obtain a copy of the License at
      -#
      -#   http://www.apache.org/licenses/LICENSE-2.0
      -#
      -# Unless required by applicable law or agreed to in writing,
      -# software distributed under the License is distributed on an
      -# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
      -# KIND, either express or implied.  See the License for the
      -# specific language governing permissions and limitations
      -# under the License.
      -#
      -.
      -.
      -.
      -9. Accepting Warranty or Additional Liability. While redistributing
      -the Work or Derivative Works thereof, You may choose to offer, and
      -charge a fee for, acceptance of support, warranty, indemnity, or
      -other liability obligations and/or rights consistent with this
      -License. However, in accepting such obligations, You may act only
      -on Your own behalf and on Your sole responsibility, not on behalf
      -of any other Contributor, and only if You agree to indemnify, defend,
      -and hold each Contributor harmless for any liability incurred by,
      -or claims asserted against, such Contributor by reason of your
      -accepting any such warranty or additional liability.
      -
      -END OF TERMS AND CONDITIONS
      -
      -BY TYPING "ACCEPT" YOU AGREE TO THE TERMS OF THIS AGREEMENT: ***INFO: testing sudo access
      -***INFO: Starting Trafodion Package Setup (2016-06-30-21-06-40)
      -***INFO: Installing required packages
      -***INFO: Log file located in /var/log/trafodion
      -***INFO: ... pdsh on node ip-172-31-56-238
      -***INFO: ... pdsh on node ip-172-31-61-110
      -***INFO: ... pdsh on node ip-172-31-57-143
      -***INFO: Checking if apr is installed ...
      -***INFO: Checking if apr-util is installed ...
      -***INFO: Checking if sqlite is installed ...
      -***INFO: Checking if expect is installed ...
      -***INFO: Checking if perl-DBD-SQLite* is installed ...
      -***INFO: Checking if protobuf is installed ...
      -***INFO: Checking if xerces-c is installed ...
      -***INFO: Checking if perl-Params-Validate is installed ...
      -***INFO: Checking if perl-Time-HiRes is installed ...
      -***INFO: Checking if gzip is installed ...
      -***INFO: Checking if lzo is installed ...
      -***INFO: Checking if lzop is installed ...
      -***INFO: Checking if unzip is installed ...
      -***INFO: modifying limits in /usr/lib/trafodion/trafodion.conf on all nodes
      -***INFO: create Trafodion userid "trafodion"
      -***INFO: Trafodion userid's (trafodion) home directory: /opt/trafodion
      -***INFO: testing sudo access
      -Generating public/private rsa key pair.
      -Created directory '/opt/trafodion/.ssh'.
      -Your identification has been saved in /opt/trafodion/.ssh/id_rsa.
      -Your public key has been saved in /opt/trafodion/.ssh/id_rsa.pub.
      -The key fingerprint is:
      -12:59:ab:d7:59:a2:0e:e8:38:1c:e9:e1:86:f6:18:23 trafodion@ip-172-31-56-238
      -The key's randomart image is:
      -+--[ RSA 2048]----+
      -|        .        |
      -|       o .       |
      -|      o . . .    |
      -|   . . o o +     |
      -|  + . + S o      |
      -| = =   =         |
      -|E+B .   .        |
      -|o.=.             |
      -| . .             |
      -+-----------------+
      -***INFO: creating .bashrc file
      -***INFO: Setting up userid trafodion on all other nodes in cluster
      -***INFO: Creating known_hosts file for all nodes
      -ip-172-31-56-238
      -ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143
      -ip-172-31-61-110
      -ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143
      -ip-172-31-57-143
      -ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143
      -***INFO: trafodion user added successfully
      -***INFO: Trafodion environment setup completed
      -***INFO: creating sqconfig file
      -***INFO: Reserving DCS ports
      -
      -***INFO: Creating trafodion sudo access file
      -
      -
      -******************************
      - TRAFODION MODS
      -******************************
      -
      -***INFO: Hortonworks installed will run traf_hortonworks_mods
      -***INFO: copying hbase-trx-hdp2_3-*.jar to all nodes
      -***INFO: hbase-trx-hdp2_3-*.jar copied correctly! Huzzah.
      -USERID=admin
      -PASSWORD=admin
      -PORT=:8080
      -{
      -  "resources" : [
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/configurations/service_config_versions?ser
      -vice_name=HBASE&service_config_version=2",
      -.
      -.
      -.
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/128",
      -      "Tasks" : {
      -        "cluster_name" : "trafodion",
      -        "id" : 128,
      -        "request_id" : 12,
      -        "stage_id" : 2
      -      }
      -    },
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/129",
      -      "Tasks" : {
      -        "cluster_name" : "trafodion",
      -        "id" : 129,
      -        "request_id" : 12,
      -        "stage_id" : 2
      -      }
      -    },
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/130",
      -      "Tasks" : {
      -        "cluster_name" : "trafodion",
      -        "id" : 130,
      -        "request_id" : 12,
      -        "stage_id" : 2
      -      }
      -    }
      -  ],
      -  "stages" : [
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/0",
      -      "Stage" : {
      -        "cluster_name" : "trafodion",
      -        "request_id" : 12,
      -        "stage_id" : 0
      -      }
      -    },
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/1",
      -      "Stage" : {
      -        "cluster_name" : "trafodion",
      -        "request_id" : 12,
      -        "stage_id" : 1
      -      }
      -    },
      -    {
      -      "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/2",
      -      "Stage" : {
      -        "cluster_name" : "trafodion",
      -        "request_id" : 12,
      -        "stage_id" : 2
      -      }
      -    }
      -  ]
      -}***INFO: ...polling every 30 seconds until HBase start is completed.
      -***INFO: HBase restart completed
      -***INFO: Setting HDFS ACLs for snapshot scan support
      -cp: `trafodion_config' and `/home/trafinstall/trafodion-2.0.1/installer/trafodion_config' are the same file
      -***INFO: Trafodion Mods ran successfully.
      -
      -******************************
      - TRAFODION CONFIGURATION
      -******************************
      -
      -/usr/lib/trafodion/installer/..
      -/opt/trafodion/apache-trafodion_server-2.0.1-incubating
      -***INFO: untarring file  to /opt/trafodion/apache-trafodion_server-2.0.1-incubating
      -***INFO: modifying .bashrc to set Trafodion environment variables
      -***INFO: copying .bashrc file to all nodes
      -***INFO: copying sqconfig file (/opt/trafodion/sqconfig) to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/sql/script
      -s/sqconfig
      -***INFO: Creating /opt/trafodion/apache-trafodion_server-2.0.1-incubating directory on all nodes
      -***INFO: Start of DCS install
      -***INFO: DCS Install Directory: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1
      -***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/dcs-env.sh
      -***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/dcs-site.xml
      -***INFO: creating /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/servers file
      -***INFO: End of DCS install.
      -***INFO: Start of REST Server install
      -***INFO: Rest Install Directory: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1
      -***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1/conf/rest-site.xml
      -***INFO: End of REST Server install.
      -***INFO: starting sqgen
      -ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110
      -
      -Creating directories on cluster nodes
      -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
      -fodion/apache-trafodion_server-2.0.1-incubating/etc
      -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
      -fodion/apache-trafodion_server-2.0.1-incubating/logs
      -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
      -fodion/apache-trafodion_server-2.0.1-incubating/tmp
      -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
      -fodion/apache-trafodion_server-2.0.1-incubating/sql/scripts
      -
      -Generating SQ environment variable file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/etc/ms.env
      -
      -Note: Using cluster.conf format type 2.
      -
      -Generating SeaMonster environment variable file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/etc/seamonster.env
      -
      -
      -Generated SQ startup script file: ./gomon.cold
      -Generated SQ startup script file: ./gomon.warm
      -Generated SQ cluster config file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/tmp/cluster.conf
      -Generated SQ Shell          file: sqshell
      -Generated RMS Startup       file: rmsstart
      -Generated RMS Stop          file: rmsstop
      -Generated RMS Check         file: rmscheck.sql
      -Generated SSMP Startup      file: ssmpstart
      -Generated SSMP Stop         file: ssmpstop
      -Generated SSCP Startup      file: sscpstart
      -Generated SSCP Stop         file: sscpstop
      -
      -
      -Copying the generated files to all the nodes in the cluster
      -.
      -.
      -.
      -SQ Startup script (/opt/trafodion/apache-trafodion_server-2.0.1-incubating/sql/scripts/gomon.cold) ran successfully. Performin
      -g further checks...
      -Checking if processes are up.
      -Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
      -
      -The SQ environment is up!
      -
      -
      -Process                Configured        Actual            Down
      --------                ----------        ------            ----
      -DTM                3                3
      -RMS                6                6
      -DcsMaster        1                0            1
      -DcsServer        3                0            3
      -mxosrvr                96                0            96
      -
      -Thu Jun 30 21:15:29 UTC 2016
      -Checking if processes are up.
      -Checking attempt: 1; user specified max: 1. Execution time in seconds: 0.
      -
      -The SQ environment is up!
      -
      -
      -Process                Configured        Actual            Down
      --------                ----------        ------            ----
      -DTM                3                3
      -RMS                6                6
      -DcsMaster        1                0            1
      -DcsServer        3                0            3
      -mxosrvr                96                0            96
      -
      -Starting the DCS environment now
      -starting master, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dcs-trafodion-1-mast
      -er-ip-172-31-56-238.out
      -ip-172-31-56-238: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc
      -s-trafodion-1-server-ip-172-31-56-238.out
      -ip-172-31-57-143: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc
      -s-trafodion-3-server-ip-172-31-57-143.out
      -ip-172-31-61-110: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc
      -s-trafodion-2-server-ip-172-31-61-110.out
      -Checking if processes are up.
      -Checking attempt: 1; user specified max: 2. Execution time in seconds: 1.
      -
      -The SQ environment is up!
      -
      -
      -Process                Configured        Actual            Down
      --------                ----------        ------            ----
      -DTM                3                3
      -RMS                6                6
      -DcsMaster        1                1
      -DcsServer        3                3
      -mxosrvr                96                7            89
      -
      -Starting the REST environment now
      -starting rest, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1/bin/../logs/rest-trafodion-1-rest
      --ip-172-31-56-238.out
      -
      -
      -
      -Zookeeper listen port: 2181
      -DcsMaster listen port: 23400
      -
      -Configured Primary DcsMaster: "ip-172-31-56-238.ec2.internal"
      -Active DcsMaster            : "ip-172-31-56-238"
      -
      -Process                Configured        Actual                Down
      ----------        ----------        ------                ----
      -DcsMaster        1                1
      -DcsServer        3                3
      -mxosrvr                96                94                2
      -
      -
      -You can monitor the SQ shell log file : /opt/trafodion/apache-trafodion_server-2.0.1-incubating/logs/sqmon.log
      -
      -
      -Startup time  0 hour(s) 2 minute(s) 19 second(s)
      -Apache Trafodion Conversational Interface 2.0.1
      -Copyright (c) 2015-2016 Apache Software Foundation
      ->>
      ---- SQL operation complete.
      ->>
      -
      -End of MXCI Session
      -
      -***INFO: Installation setup completed successfully.
      -
      -******************************
      - TRAFODION INSTALLATION END
      -******************************
      -
      -
      -
    2. -
    3. -

      Switch to the Trafodion Runtime User and check the status of Trafodion.

      -
      -
      -
      $ sudo su - trafodion
      -$ sqcheck
      -Checking if processes are up.
      -Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
      -
      -The SQ environment is up!
      -
      -
      -Process                Configured        Actual            Down
      --------                ----------        ------            ----
      -DTM                3                3
      -RMS                6                6
      -DcsMaster        1                1
      -DcsServer        3                3
      -mxosrvr                96                96
      -$
      -
      -
      -
    4. -
    -
    -
    -

    Trafodion is now running on your Hadoop cluster. Please refer to the Activate chapter for -basic instructions on how to verify the Trafodion management and how to perform basic management -operations.

    +

    Please refer to Guided Install for the example of installing Trafodion on a two-node Cloudera Hadoop cluster.

    @@ -1735,9 +1285,9 @@ respective environment’s configuration settings per Trafodion requirements about the requirements and usage associated with this user ID.

  • -

    Runtime User: A Linux-level user under which the Trafodion software runs. This user ID must be registered -as a user in the Hadoop Distributed File System (HDFS) to store and access objects in HDFS, HBase, and Hive. -In addition, this user ID requires passwordless access among the nodes where Trafodion is installed. +

    Runtime User: A Linux-level user under which the Trafodion software runs, default name is trafodion. This user ID must be registered +as a user in the Hadoop Distributed File System (HDFS) to store and access objects in HDFS, HBase, and Hive. +In addition, this user ID requires passwordless access among the nodes where Trafodion is installed. Refer to Trafodion Runtime User for more information about this user ID.

  • @@ -1786,40 +1336,28 @@ such as LDAP search. Refer to

    3.2. Provisioning Options

    -

    Trafodion ships with a set of scripts that takes care of many of the installation and upgrade -tasks associated with the Trafodion software and its requirements. The main features include:

    +

    Trafodion includes two options for installation: a plug-in integration with Apache Ambari and command-line installation scripts.

    -
    -
      -
    • -

      Trafodion installer: Performs installation and upgrade for Trafodion

      -
    • -
    • -

      Trafodion uninstaller: Uninstalls Trafodion

      -
    • -
    • -

      Trafodion security installer: Enables security features including Kerberos and LDAP for an existing Trafodion installation

      -
    • -
    +
    +

    The Ambari integration provides support for Hortonworks Hadoop distributions, while the command-line Trafodion Installer +supports Cloudera and Hortonworks Hadoop distributions, and for select vanilla Hadoop installations.

    -

    Currently, the Trafodion Installer is able to install Trafodion on select Cloudera and Hortonworks Hadoop distributions, and for select vanilla Hadoop installations. -The Trafodion Installer limitations are noted as they apply in the different chapters below. For example, the Trafodion Installer -is less capable on SUSE than it is on RedHat/CentOS; you have to install the prerequisite software packages outside the Trafodion Installer.

    +

    The Trafodion Installer supports Linux distributions SUSE and RedHat/CentOS. There are, however, some differences. +Prerequisite software packages are not installed automatically on SUSE.

    -

    The Trafodion Installer automates many of the tasks required to install/upgrade Trafodion, spanning from downloading and -installing required software packages and making required changes to your Hadoop environment via creating +

    The Trafodion Installer automates many of the tasks required to install/upgrade Trafodion, from downloading and +installing required software packages and making required configuration changes to your Hadoop environment via creating the Trafodion runtime user ID to installing and starting Trafodion. It is, therefore, highly recommend that you use the Trafodion Installer for initial installation and upgrades of Trafodion. These steps are referred to as "Script-Based Provisioning" in this guide. Refer to Trafodion Installer that provides usage information.

    -

    If, for any reason, you choose not to use the Trafodion Installer, then separate chapters provide -step-by-step recipes for the tasks required to install/upgrade Trafodion. These steps are referred to as -Recipe-Based Provisioning in this guide. It is assumed that you are well-versed in Linux and Hadoop -administrative tasks if using Recipe-Based Provisioning.

    +

    The command-line installer has been replaced for the 2.1.0 release. Written in python, it replaces the legacy bash-script installer. +The bash command-line installer is deprecated as of 2.1.0, but is still provided, just in case you experience any problems with +the new installer. If so, please report those problems to the project team, since the legacy installer will soon be obsoleted.

    @@ -1862,7 +1400,7 @@ include basic management tasks such as starting and checking the status of the T
  • Enable Security: Activities related to enabling security features on an already installed Trafodion installation. These activities include tasks such as adding Kerberos principals and keytabs, -and setting up the LDAP configuration files.

    +and setting up the LDAP configuration files. Only support in bash installer for now

  • @@ -1870,9 +1408,9 @@ and setting up the LDAP configuration files.

    3.4. Provisioning Master Node

    -

    All provisioning tasks are performed from a single node in the cluster, which must be part -of the Hadoop environment you’re adding Trafodion to. This node is referred to as the -"Provisioning Master Node" in this guide.

    +

    All provisioning tasks are performed from a single node in the cluster, which can be any node +as long as it has access to the Hadoop environment you’re adding Trafodion to. +This node is referred to as the "Provisioning Master Node" in this guide.

    The Trafodion Provisioning User must have access to all other nodes from the Provisioning @@ -1893,7 +1431,7 @@ Next, you unpack the tar file.

    $ mkdir $HOME/trafodion-installer
     $ cd $HOME/trafodion-downloads
    -$ tar -zxf apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -C $HOME/trafodion-installer
    +$ tar -zxf apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz -C $HOME/trafodion-installer
     $
    @@ -1907,17 +1445,16 @@ $

    Guided Setup: Prompts for information as it works through the installation/upgrade process. This mode is recommended for new users.

  • -

    Automated Setup: Required information is provided in a pre-formatted bash-script configuration file, which is provided -via a command argument when running the Trafodion Installer thereby suppressing all prompts. There is one exception, -if Kerberos is enabled on the cluster, then you will always be prompted for the KDC admin password. We do not store the -KDC admin password as part of installation anywhere.

    +

    Automated Setup: Required information is provided in a pre-formatted ini configuration file, which is provided +via a command argument when running the Trafodion Installer thereby suppressing all prompts. This ini configuration file only exists +on the Provisioning Master Node, please secure this file or delete it after you installed Trafodion successfully.

    -

    A template of the configuration file is available here within the installer directory: trafodion_config_default. +

    A template of the configuration file is available here within the installer directory: configs/db_config_default.ini. Make a copy of the file in your directory and populate the needed information.

    Automated Setup is recommended since it allows you to record the required provisioning information ahead of time. -Refer to Automated Setup for information about how to +Refer to Automated Setup for information about how to populate this file.

  • @@ -1930,21 +1467,30 @@ populate this file.

    -
    ./trafodion_install --help
    -
    -This script will install Trafodion. It will create a configuration
    -file (if one has not been created), setup of the environment needed
    -for Trafodion, configure HBase with Hbase-trx and co-processors needed,
    -and install a specified Trafodion build.
    +
    $ ./db_install.py -h
    +**********************************
    +  Trafodion Installation ToolKit
    +**********************************
    +Usage: db_install.py [options]
    +  Trafodion install main script.
     
     Options:
    -    --help             Print this message and exit
    -    --accept_license   If provided, the user agrees to accept all the
    -                       provisions in the Trafodion license.  This allows
    -                       for automation by skipping the display and prompt of
    -                       the Trafodion license.
    -    --config_file      If provided, all install prompts will be
    -                       taken from this file and not prompted for.
    + -h, --help show this help message and exit + -c FILE, --config-file=FILE + Json format file. If provided, all install prompts + will be taken from this file and not prompted for. + -u USER, --remote-user=USER + Specify ssh login user for remote server, + if not provided, use current login user as default. + -v, --verbose Verbose mode, will print commands. + --silent Do not ask user to confirm configuration result + --enable-pwd Prompt SSH login password for remote hosts. + If set, 'sshpass' tool is required. + --build Build the config file in guided mode only. + --reinstall Reinstall Trafodion without restarting Hadoop. + --apache-hadoop Install Trafodion on top of Apache Hadoop. + --offline Enable local repository for offline installing + Trafodion.
    @@ -1963,6 +1509,10 @@ or an upgrade by looking for the Trafodion Runtime User in the /etc/passwd
  • If the user ID exists, then the Trafodion Installer runs in upgrade mode.

  • +
  • +

    If --reinstall option is specified, then the Trafodion Installer will not restart Hadoop. It’s only available when +you reinstall the same release version, otherwise an error will be reported during installation.

    +
  • @@ -1989,7 +1539,7 @@ that it prompts you for information during the install/upgrade process.

    3.5.4. Automated Setup

    -

    The --config_file option runs the Trafodion in Automated Setup mode.

    +

    The --config-file option runs the Trafodion in Automated Setup mode.

    Before running the Trafodion Installer with this option, you do the following:

    @@ -1997,13 +1547,13 @@ that it prompts you for information during the install/upgrade process.

    1. -

      Copy the trafodion_config_default file.

      +

      Copy the db_config_default.ini file.

      Example

      -
      cp trafodion_config_default my_config
      +
      cp configs/db_config_default.ini my_config
    2. @@ -2019,7 +1569,7 @@ section in the Prepare chapter.

    -
    ./trafodion_installer --config_file my_config
    +
    ./db_install.py --config-file my_config
    @@ -2039,476 +1589,148 @@ that matches the security policies of your organization.
    -
    - - - - - -
    - - -If you are installing Trafodion on a version of Hadoop that has been instrumented with Kerberos, -you will be asked for a password associated with a Kerberos administrator. -
    +
    +
    Example: Quick start using a Trafodion Configuration File
    +
    +

    The Trafodion Installer supports a minimum configuration to quick start your installation in two steps. +1. Copy Trafodion server binary file to your installer directory.

    +
    +
    +
    +
    cp /path/to/apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz python-installer/
    +
    +
    +
    +
      +
    1. +

      Modify configuration file my_config, add the Hadoop Distribution Manager URL in mgr_url.

      +
    2. +
    +
    +
    +
    +
    mgr_url = 192.168.0.1:8080
    +
    +
    +
    +

    Once completed, run the Trafodion Installer with the --config-file option.

    +
    Example: Creating a Trafodion Configuration File

    Using the instructions in Gather Configuration Information -in the Prepare chapter, you record the following information.

    -
    - ----- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
    IDInformationSetting
    ADMIN

    Administrator user name for Apache Ambari or Cloudera Manager.

    admin

    ADMIN_PRINCIPAL

    Kerberos principal for the KDC admin user including the realm.

    BACKUP_DCS_NODES

    List of nodes where to start the backup DCS Master components.

    CLOUD_CONFIG

    Whether you’re installing Trafodion on a cloud environment.

    N

    CLOUD_TYPE

    What type of cloud environment you’re installing Trafodion on.

    CLUSTER_NAME

    The name of the Hadoop Cluster.

    Cluster 1

    DB_ROOT_NAME

    LDAP name used to connect as database root user

    trafodion

    DCS_BUILD

    Tar file containing the DCS component.

    DCS_PRIMARY_MASTER_NODE

    The node where the primary DCS should run.

    DCS_SERVER_PARM

    Number of concurrent client sessions per node.

    8

    ENABLE_HA

    Whether to run DCS in high-availability (HA) mode.

    N

    EPEL_RPM

    Location of EPEL RPM. Specify if you don’t have access to the Internet.

    FLOATING_IP

    IP address if running DCS in HA mode.

    HADOOP_TYPE

    The type of Hadoop distribution you’re installing Trafodion on.

    cloudera

    HBASE_GROUP

    Linux group name for the HBASE administrative user.

    hbase

    HBASE_KEYTAB

    Kerberos service keytab for HBase admin principal.

    Default based on distribution

    HBASE_USER

    Linux user name for the HBASE administrative user.

    hbase

    HDFS_KEYTAB

    Kerberos service keytab for HDFS admin principal.

    Default based on distribution

    HDFS_USER

    Linux user name for the HDFS administrative user.

    hdfs

    HOME_DIR

    Root directory under which the trafodion home directory should be created.

    /home

    INIT_TRAFODION

    Whether to automatically initialize the Trafodion database.

    Y

    INTERFACE

    Interface type used for $FLOATING_IP.

    JAVA_HOME

    Location of Java 1.7.0_65 or higher (JDK).

    /usr/java/jdk1.7.0_67-cloudera

    KDC_SERVER

    Location of Kerberos server for admin access

    LDAP_CERT

    Full path to TLS certificate.

    LDAP_HOSTS

    List of nodes where LDAP Identity Store servers are running.

    LDAP_ID

    List of LDAP unique identifiers.

    LDAP_LEVEL

    LDAP Encryption Level.

    LDAP_PASSWORD

    Password for LDAP_USER.

    LDAP_PORT

    Port used to communicate with LDAP Identity Store.

    LDAP_SECURITY

    Whether to enable LDAP authentication.

    N

    LDAP_USER

    LDAP Search user name.

    LOCAL_WORKDIR

    The directory where the Trafodion Installer is located.

    /home/centos/trafodion-installer/installer

    MANAGEMENT_ENABLED

    Whether your installation uses separate management nodes.

    N

    MANAGEMENT_NODES

    The FQDN names of management nodes, if any.

    MAX_LIFETIME

    Kerberos ticket lifetime for Trafodion principal

    24hours

    NODE_LIST

    The FQDN names of the nodes where Trafodion will be installed.

    trafodion-1 trafodion-2

    PASSWORD

    Administrator password for Apache Ambari or Cloudera Manager.

    admin

    RENEW_LIFETIME

    Kerberos ticket renewal lifetime for Trafodion principal

    7days

    REST_BUILD

    Tar file containing the REST component.

    SECURE_HADOOP

    Indicates whether Hadoop has Kerberos enabled

    Based on whether Kerberos is enabled for your Hadoop installation

    TRAF_HOME

    Target directory for the Trafodion software.

    /home/trafodion/apache-trafodion-1.3.0-incubating-bin

    START

    Whether to start Trafodion after install/upgrade.

    Y

    SUSE_LINUX

    Whether your installing Trafodion on SUSE Linux.

    false

    TRAF_PACKAGE

    The location of the Trafodion installation package tar file or core installation tar file.

    /home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz

    TRAF_KEYTAB

    Kerberos keytab for trafodion principal.

    Default keytab based on distribution

    TRAF_KEYTAB_DIR

    Location of Kerberos keytab for the trafodion principal.

    Default location based on distribution

    TRAF_USER

    The Trafodion runtime user ID. Must be trafodion in this release.

    trafodion

    TRAF_USER_PASSWORD

    The password used for the trafodion:trafodion user ID.

    traf123

    URL

    FQDN and port for the Distribution Manager’s REST API.

    trafodion-1.apache.org:7180

    -
    -

    Next, you edit my_config to contain the following:

    +in the Prepare chapter, record the information and edit my_config to contain the following:

    -
    #!/bin/bash
    -# @@@ START COPYRIGHT @@@
    -#
    -# Licensed to the Apache Software Foundation (ASF) under one
    -# or more contributor license agreements.  See the NOTICE file
    -# distributed with this work for additional information
    -# regarding copyright ownership.  The ASF licenses this file
    -# to you under the Apache License, Version 2.0 (the
    -# "License"); you may not use this file except in compliance
    -# with the License.  You may obtain a copy of the License at
    -#
    -#   http://www.apache.org/licenses/LICENSE-2.0
    -#
    -# Unless required by applicable law or agreed to in writing,
    -# software distributed under the License is distributed on an
    -# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
    -# KIND, either express or implied.  See the License for the
    -# specific language governing permissions and limitations
    -# under the License.
    -#
    -# @@@ END COPYRIGHT @@@
    -
    -#====================================================
    -# Trafodion Configuration File
    -# This file contains default values for the installer.
    -
    -# Users can also edit this file and provide values for all parameters
    -# and then specify this file on the run line of trafodion_install.
    -# Example:
    -# ./trafodion_install --config_file <Trafodion-config-file>
    -# WARNING: This mode is for advanced users!
    -#
    -#=====================================================
    -
    -
    -#=====================================================
    -#Must be set to 'true' if on a SUSE linux system. If on another type of system
    -#this must be set to false.
    -
    -export SUSE_LINUX="false"
    -
    -# The working directory where Trafodion installer untars files, etc.
    -# do not change this unless you really know what you are doing
    -export TRAF_WORKDIR="/usr/lib/trafodion"
    -
    -# This is the directory where the installer scripts were untarred to
    -export LOCAL_WORKDIR="/home/centos/trafodion-installer/installer"
    -
    -# The maximum number of dcs servers, i.e. client connections
    -export DCS_SERVERS_PARM="8"
    -
    -# "true" if this is an upgrade
    -export UPGRADE_TRAF="false"
    -
    -# Trafodion userid, This is the userid the Trafodion instance will run under
    -export TRAF_USER="trafodion"
    -
    -# Trafodion userid's password
    -export TRAF_USER_PASSWORD="traf123"
    -
    -# a blank separated list of nodes in your cluster
    -# node names should include full domain names
    -#This can not be left blank!
    -export NODE_LIST="trafodion-1 trafodion-2"
    -
    -# count of nodes in node list
    -export node_count="2"
    -
    -# another list of the same nodes in NODE_LIST but specified in a pdsh usable format
    -# i.e.  "-w centos-cdh[1-6]"  or "-w node1 -w node2 -w node3"
    -export MY_NODES="-w trafodion-[1-2]"
    -
    -# the directory prefix for the trafodion userid's $HOME directory
    -# i.e. /opt/home, not /opt/home/trafodion
    -export HOME_DIR="/home"
    -
    -#JAVA HOME must be a JDK. Must include FULL Path. Must be 1.7.0_65 or higher.
    -
    -export JAVA_HOME="/usr/java/jdk1.7.0_67-cloudera"
    -
    -# If your machine doesn't have external internet access then you must
    -# specify the location of the EPEL rpm, otherwise leave blank and it
    -# will be installed from the internet
    -export EPEL_RPM=""
    -
    -# full path of the Trafodion package tar file
    -export TRAF_PACKAGE="/home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz"
    -
    -# if TRAF_PACKAGE wasn't specified then these two values must be specified
    -# TRAF_BUILD is the trafodion_server tar file
    -# DCS_BUILD is the DCS tar file
    -# REST_BUILD is the REST tar file
    -export TRAF_BUILD=""
    -export DCS_BUILD=""
    -export REST_BUILD=""
    -# Either "cloudera" or "hortonworks" (all lowercase)
    -export HADOOP_TYPE="cloudera"
    -
    -# The URL for Cloudera/Hortonworks REST API (i.e. node1.host.com:8080)
    -export URL="trafodion-1.apache.org:7180"
    -
    -# Cloudera/Hortonworks UI admin's userid and password
    -export ADMIN="admin"
    -export PASSWORD="admin"
    -
    -# hadoop cluster name
    -export CLUSTER_NAME=""
    -
    -# the Hadoop HDFS userid
    -export HDFS_USER="hdfs"
    -
    -# the Hadoop HBase userid and group
    -export HBASE_USER="hbase"
    -export HBASE_GROUP="hbase"
    -
    -# The hadoop HBase service name
    -export HBASE="hbase"
    -
    -# full path of where to install Trafodion to
    -# Example is used below. If $HOME_DIR or $TRAF_USER have been changed
    -# then this will need to be changed.
    -# On an upgrade, it is recommend to choose a different directory.
    -# First time install : /home/trafodion/traf
    -# On Upgrade: /home/trafodion/traf_<date>
    -# By doing this the previous version will remain and allow for an easier rollback.
    -export TRAF_HOME="/home/trafodion/apache-trafodion-1.3.0-incubating-bin"
    -
    -# Start Trafodion after install completes
    -export START="Y"
    -
    -# initialize trafodion after starting
    -export INIT_TRAFODION="Y"
    -
    -# full path to the sqconfig file
    -# Default is to leave as is and this file will be created.
    -export SQCONFIG=""
    -
    -#-----------------  security configuration information -----------------
    -#Enter in Kerberos details if Kerberos is enabled on your cluster
    -
    -#Indicate Kerberos is enabled
    -export SECURE_HADOOP="N"
    -
    -#Location of Kerberos server for admin access
    -export KDC_SERVER=""
    -
    -#Kerberos Admin principal used to create Trafodion principals and keytabs
    -#Please include realm, for example: trafadmin/admin@MYREALM.COM
    -export ADMIN_PRINCIPAL=""
    -
    -#Keytab for HBase admin user, used to grant Trafodion user CRWE privilege
    -export HBASE_KEYTAB=""
    -
    -#Keytab for HDFS admin user, used to create data directories for Trafodion
    -export HDFS_KEYTAB=""
    -
    -#Kerberos ticket defaults for the Trafodion user
    -export MAX_LIFETIME="24hours"
    -export RENEW_LIFETIME="7days"
    -
    -#Trafodion keytab information
    -export TRAF_KEYTAB=""
    -export TRAF_KEYTAB_DIR=""
    -
    -#Enter in LDAP configuration information
    -#Turn on authentication - MUST have existing LDAP configured.
    -export LDAP_SECURITY="Y"
    -
    -#Name of LDAP Config file
    -export LDAP_AUTH_FILE="traf_authentication_config_`hostname -s`"
    -
    -#LDAP name to map to database user DB__ROOT
    -DB_ROOT_NAME="trafodion"
    -#-----------------      end security configuration     -----------------
    -
    -export CONFIG_COMPLETE="true"
    -
    -
    -
    -

    Once completed, run the Trafodion Installer with the --config_file option.

    +
    [dbconfigs]
    +# NOTICE: if you are using CDH/HDP hadoop distro,
    +# you can only specifiy management url address for a quick install
    +
    +##################################
    +# Common Settings
    +##################################
    +
    +# trafodion username and password
    +traf_user = trafodion
    +traf_pwd = traf123
    +# trafodion user's home directory
    +home_dir = /home
    +# the directory location of trafodion binary
    +# if not provided, the default value will be {package_name}-{version}
    +traf_dirname =
    +
    +# trafodion used java(JDK) path on trafodion nodes
    +# if not provided, installer will auto detect installed JDK
    +java_home =
    +
    +# cloudera/ambari management url(i.e. http://192.168.0.1:7180 or just 192.168.0.1)
    +# if 'http' or 'https' prefix is not provided, the default one is 'http'
    +# if port is not provided, the default port is cloudera port '7180'
    +mgr_url = 192.168.0.1:8080
    +# user name for cloudera/ambari management url
    +mgr_user = admin
    +# password for cloudera/ambari management url
    +mgr_pwd = admin
    +# set the cluster number if multiple clusters managed by one Cloudera manager
    +# ignore it if only one cluster being managed
    +cluster_no = 1
    +
    +# trafodion tar package file location
    +# no need to provide it if the package can be found in current installer's directory
    +traf_package =
    +# the number of dcs servers on each node
    +dcs_cnt_per_node = 4
    +
    +# scratch file location, seperated by comma if more than one
    +scratch_locs = $TRAF_HOME/tmp
    +
    +# start trafodion instance after installation completed
    +traf_start = Y
    +
    +##################################
    +# DCS HA configuration
    +##################################
    +
    +# set it to 'Y' if enable DCS HA
    +dcs_ha = N
    +# if HA is enabled, provide floating ip, network interface and the hostname of backup dcs master nodes
    +dcs_floating_ip =
    +# network interface that dcs used
    +dcs_interface =
    +# backup dcs master nodes, seperated by comma if more than one
    +dcs_backup_nodes =
    +
    +##################################
    +# Offline installation setting
    +##################################
    +
    +# set offline mode to Y if no internet connection
    +offline_mode = N
    +# if offline mode is set, you must provide a local repository directory with all needed RPMs
    +local_repo_dir =
    +
    +##################################
    +# LDAP security configuration
    +##################################
    +
    +# set it to 'Y' if enable LDAP security
    +ldap_security = N
    +# LDAP user name and password to be assigned as DB admin privilege
    +db_admin_user = admin
    +db_admin_pwd = traf123
    +# LDAP user to be assigned DB root privileges (DB__ROOT)
    +db_root_user = trafodion
    +# if LDAP security is enabled, provide the following items
    +ldap_hosts =
    +# 389 for no encryption or TLS, 636 for SSL
    +ldap_port = 389
    +ldap_identifiers =
    +ldap_encrypt = 0
    +ldap_certpath =
    +
    +# set to Y if user info is needed
    +ldap_userinfo = N
    +# provide if ldap_userinfo = Y
    +ladp_user =
    +ladp_pwd =
    +
    +##################################
    +# Kerberos security configuration
    +##################################
    +# if kerberos is enabled in your hadoop system, provide below info
    +
    +# KDC server address
    +kdc_server =
    +# include realm, i.e. admin/admin@EXAMPLE.COM
    +admin_principal =
    +# admin password for admin principal, it is used to create trafodion user's principal and keytab
    +kdcadmin_pwd =
    +
    +
    +
    +

    Once completed, run the Trafodion Installer with the --config-file option.

    Refer to the following sections for examples:

    @@ -2536,9 +1758,6 @@ export CONFIG_COMPLETE="true"
  • /etc/trafodion: Configuration information.

  • -
  • -

    /usr/lib/trafodion: Copies of the files required by the installer.

    -
  • @@ -2556,13 +1775,13 @@ export CONFIG_COMPLETE="true"
    • -

      64-bit Red Hat Enterprise Linux (RHEL) or CentOS 6.5, 6.6, and 6.7

      +

      64-bit Red Hat Enterprise Linux (RHEL) or CentOS 6.5 - 6.8

    • -

      Cloudera CDH 5.4

      +

      Cloudera CDH 5.4 - 5.7

    • -

      Hortonworks HDP 2.3

      +

      Hortonworks HDP 2.3 - 2.4

    @@ -2660,9 +1879,11 @@ A minimum of two cores is required regardless of whether you’re deploying

    Linux

    -

    64-bit version of Red Hat 6.5 or later, or SUSE SLES 11.3 or later.

    +

    64-bit version of Red Hat(RHEL) or CentOS 6.5 -6.8

    +
    +
    +

    cat /etc/redhat-release

    -
    @@ -2815,50 +2036,6 @@ the port is not open.

    scp --help

    - -
    -

    curl

    -
    -
    -

    Available to transfer data with URL syntax.

    -
    -
    -

    curl --version

    -
    - - -
    -

    wget

    -
    -
    -

    Available to download files from the Web.

    -
    -
    -

    wget --version

    -
    - - -
    -

    pdsh

    -
    -
    -

    Available to run shell commands in parallel.

    -
    -
    -

    pdsh -V

    -
    - - -
    -

    pdcp

    -
    -
    -

    Available to copy files among nodes in parallel. part of the pdsh package.

    -
    -
    -

    pdcp -V

    -
    - @@ -3131,7 +2308,7 @@ tools that are not typically packaged as part of the core Linux distribution.

    For RedHat/CentOS, the Trafodion Installer automatically attempts get a subset of these packages over the Internet. If the cluster’s access to the Internet is disabled, then you need to manually download the packages and make them available -for installation. You need to build and install log4c++ manually. +for installation. @@ -3162,11 +2339,6 @@ for installation. You need to build and install log4c++ man
    yum install pdsh
    -

    log4cxx

    -

    Message logging.

    -
    Manual process1
    - -

    sqlite

    Internal configuration information managed by the Trafodion Foundation component.

    yum install sqlite
    @@ -3207,50 +2379,27 @@ for installation. You need to build and install log4c++ man
    yum install gzip
    -

    rpm-build2

    -

    Build binary and source software packages.

    -
    yum install rpm-build
    - - -

    apr-devel2

    +

    apr-devel

    Support files used to build applications using the APR library.

    yum install apr-devel
    -

    apr-util-devel2

    +

    apr-util-devel

    Support files used to build applications using the APR utility library.

    yum install apr-util-devel
    - -

    doxygen2

    -

    Generate documentation from annotated C++ sources.

    -
    yum install doxygen
    - - -

    gcc2

    -

    GNU Compiler Collection

    -
    yum install gcc
    - - -

    gcc_c++2

    -

    GNU C++ compiler.

    -
    yum install gcc_c++
    - -
    -
      -
    1. -

      log4c++ was recently withdrawn from public repositories. Therefore, you will need to build the log4c++ RPM -on your system and then install the RPM using the procedure described in log4c++ Installation.

      -
    2. -
    3. -

      Software package required to build log4c++. Not required otherwise. These packages are not installed by the Trafodion Installer in this release.

      -
    4. -
    -
    -

    The Trafodion Installer requires Internet access to install the required software packages.

    +

    The Trafodion Installer requires both Internet access/Offline mode to install the required software packages. +Specify db_install.py --offline to use the offline install feature. Before that, you need to prepare a local repository +folder for all the above dependencies. +To create a local repository, be sure the createrepo package is installed, then run createrepo command in your rpm folder.

    +
    +
    +
    +
    $ createrepo -d .
    +
    @@ -3265,10 +2414,6 @@ on your system and then install the RPM using the procedure described in Trafodion requires that either HDFS ACL support or Kerberos is enabled. The Trafodion Installer will enable HDFS ACL and Kerberos support. Refer to Kerberos for more information about the requirements and usage of Kerberos in Trafodion. Refer to Apache HBase™ Reference Guide for security in HBase.

    -
    -

    Also, Trafodion requires sudo access to ip and arping so that floating or elastic IP addresses can be moved from one node to -another in case of node failures.