Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2BF40200BD2 for ; Fri, 28 Oct 2016 19:45:46 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2AA0C160B03; Fri, 28 Oct 2016 17:45:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6B3F4160AF5 for ; Fri, 28 Oct 2016 19:45:43 +0200 (CEST) Received: (qmail 61538 invoked by uid 500); 28 Oct 2016 17:45:41 -0000 Mailing-List: contact commits-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: ambari-dev@ambari.apache.org Delivered-To: mailing list commits@ambari.apache.org Received: (qmail 60900 invoked by uid 99); 28 Oct 2016 17:45:40 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Oct 2016 17:45:40 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id ADBB0F16AD; Fri, 28 Oct 2016 17:45:40 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: ncole@apache.org To: commits@ambari.apache.org Date: Fri, 28 Oct 2016 17:46:03 -0000 Message-Id: <8bbc663ebac34ca9ac1cf25fdbfe5599@git.apache.org> In-Reply-To: References: X-Mailer: ASF-Git Admin Mailer Subject: [24/38] ambari git commit: AMBARI-18727. Add upgrade packs for HDP-2.6 (aonishuk) archived-at: Fri, 28 Oct 2016 17:45:46 -0000 AMBARI-18727. Add upgrade packs for HDP-2.6 (aonishuk) Project: http://git-wip-us.apache.org/repos/asf/ambari/repo Commit: http://git-wip-us.apache.org/repos/asf/ambari/commit/61074c32 Tree: http://git-wip-us.apache.org/repos/asf/ambari/tree/61074c32 Diff: http://git-wip-us.apache.org/repos/asf/ambari/diff/61074c32 Branch: refs/heads/branch-feature-AMBARI-18634 Commit: 61074c32d63617f8abdabaae2d910c561fd37373 Parents: 4d8c195 Author: Andrew Onishuk Authored: Fri Oct 28 16:02:34 2016 +0300 Committer: Andrew Onishuk Committed: Fri Oct 28 16:02:34 2016 +0300 ---------------------------------------------------------------------- .../HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml | 1330 ++++++++++++++++++ .../stacks/HDP/2.3/upgrades/upgrade-2.6.xml | 1167 +++++++++++++++ .../HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml | 1285 +++++++++++++++++ .../stacks/HDP/2.4/upgrades/upgrade-2.6.xml | 1124 +++++++++++++++ .../HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml | 1168 +++++++++++++++ .../stacks/HDP/2.5/upgrades/upgrade-2.6.xml | 930 ++++++++++++ .../HDP/2.6/upgrades/nonrolling-upgrade-2.6.xml | 1146 +++++++++++++++ .../stacks/HDP/2.6/upgrades/upgrade-2.6.xml | 930 ++++++++++++ 8 files changed, 9080 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/ambari/blob/61074c32/ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml b/ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml new file mode 100644 index 0000000..9e141ae --- /dev/null +++ b/ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml @@ -0,0 +1,1330 @@ + + + + + 2.6.*.* + HDP-2.6 + NON_ROLLING + + org.apache.ambari.server.checks.RangerAuditDbCheck + org.apache.ambari.server.checks.AtlasPresenceCheck + + + + HDP-2.3.0.0 + + + + + + + + + + + + + UPGRADE + + true + false + + + + Before continuing, please stop all YARN queues. If yarn-site's yarn.resourcemanager.work-preserving-recovery.enabled is set to true, then you can skip this step since the clients will retry on their own. + + + + + + Before continuing, please stop all long-running applications deployed using Slider. E.g., su - yarn "/usr/hdp/current/slider-client/bin/slider stop <app_name>" + + + + + + Before continuing, please deactivate and kill any currently running topologies. + + + + + + + prepare + + + + + + false + true + false + + + + FLUME_HANDLER + + + + ACCUMULO_TRACER + ACCUMULO_GC + ACCUMULO_TSERVER + ACCUMULO_MONITOR + ACCUMULO_MASTER + + + + DRPC_SERVER + STORM_UI_SERVER + SUPERVISOR + NIMBUS + + + + KNOX_GATEWAY + + + + FALCON_SERVER + + + + OOZIE_SERVER + + + + SPARK_JOBHISTORYSERVER + SPARK_THRIFTSERVER + + + + WEBHCAT_SERVER + HIVE_SERVER + HIVE_METASTORE + + + + NODEMANAGER + RESOURCEMANAGER + APP_TIMELINE_SERVER + + + + HISTORYSERVER + + + + + UPGRADE + true + false + + + + Before continuing, please backup the Oozie Server database referenced by the Oozie server located on {{hosts.all}}. + + + Fix oozie admin users + + + + + + Before continuing, please backup the Hive Metastore database referenced by the Hive Metastore service(s) located on the following host(s): {{hosts.all}}. + + + + + + + take_snapshot + + + + + + + prepare_express_upgrade + + + + + + Before continuing, please backup the Ranger Admin database and Ranger Audit database on the following host(s): {{hosts.all}}. If audit database size is too large (greater than 3GB) then follow the below instructions: + 1. Backup the audit table from audit database. + 2. Truncate audit table. + 3. Follow upgrade process and once completed then restore audit data to audit table. + + + + + + Before continuing, please backup Ranger KMS database on the following host(s): {{hosts.all}}. + + + + + + false + true + false + + + + HBASE_REGIONSERVER + HBASE_MASTER + PHOENIX_QUERY_SERVER + + + + KAFKA_BROKER + + + + DATANODE + NAMENODE + SECONDARY_NAMENODE + ZKFC + JOURNALNODE + NFS_GATEWAY + + + + RANGER_USERSYNC + RANGER_ADMIN + + + + RANGER_KMS_SERVER + + + + ZOOKEEPER_SERVER + + + + + DOWNGRADE + true + + + + + + Before continuing, please restore the Oozie Server database referenced by the Oozie server located on {{hosts.all}}. + + + + + + Before continuing, please restore the Hive Metastore database referenced by the Hive Metastore service(s) located on the following host(s): {{hosts.all}}. + + + + + + Before continuing, please restore the Ranger Admin database and Ranger Audit database on the following host(s): {{hosts.all}}. + + + + + + Before continuing, please restore Ranger KMS database + + + + + + + + + + + + + + + UPGRADE + true + false + + + + + + + + + + + + + + Calculating Yarn Properties for Spark Shuffle + + + + + + + + + + + + + + Verifying LZO codec path for mapreduce + + + + + + + + + + + + + + + + Update HBase Env Configuration + + + + + + + + + + + Verifying LZO codec path for Tez + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Update hive-env content + + + + + + + Adjusting Oozie properties + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Calculating Ranger Properties + + + + + + Configuring Ranger Alerts + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + true + false + + + + + actionexecute + + + + + + + false + true + false + + + ZOOKEEPER_SERVER + ZOOKEEPER_CLIENT + + + + + false + true + false + + + RANGER_ADMIN + RANGER_USERSYNC + + + + + false + true + false + + + RANGER_KMS_SERVER + + + + + false + true + false + + + JOURNALNODE + ZKFC + NAMENODE + SECONDARY_NAMENODE + NFS_GATEWAY + HDFS_CLIENT + + + + + false + true + + + DATANODE + + + + + false + true + false + + + + Wait for NameNode to leave Safemode + + wait_for_safemode_off + + + + + + + false + true + + + KAFKA_BROKER + + + + + false + true + false + + + + HISTORYSERVER + MAPREDUCE2_CLIENT + + + + APP_TIMELINE_SERVER + RESOURCEMANAGER + YARN_CLIENT + + + + + false + true + + + + NODEMANAGER + + + + + false + true + false + + + HBASE_MASTER + HBASE_REGIONSERVER + HBASE_CLIENT + PHOENIX_QUERY_SERVER + + + + + false + true + + + TEZ_CLIENT + + + + MAHOUT + + + + PIG + + + + SQOOP + + + + + UPGRADE + true + + ZOOKEEPER + RANGER + RANGER_KMS + HDFS + KAFKA + YARN + MAPREDUCE2 + HBASE + + + + + false + true + false + + + 1 + + + HIVE_METASTORE + HIVE_SERVER + WEBHCAT_SERVER + + + + + false + true + false + + + HIVE_CLIENT + HCAT + + + + + false + true + false + + + SPARK_JOBHISTORYSERVER + SPARK_THRIFTSERVER + + + + + false + true + + + SPARK_CLIENT + + + + + false + true + false + + + OOZIE_SERVER + + + + + false + true + + + OOZIE_CLIENT + + + + + UPGRADE + true + + HIVE + OOZIE + SPARK + + + + + false + true + false + + + FALCON_SERVER + + + + + false + true + + + FALCON_CLIENT + + + + + false + true + + + KNOX_GATEWAY + + + + + false + true + + + NIMBUS + SUPERVISOR + STORM_UI_SERVER + DRPC_SERVER + + + + + false + true + + + SLIDER + + + + + false + true + + + FLUME_HANDLER + + + + + false + true + + + ACCUMULO_MASTER + ACCUMULO_TSERVER + ACCUMULO_MONITOR + ACCUMULO_GC + ACCUMULO_TRACER + ACCUMULO_CLIENT + + + + + UPGRADE + true + + FALCON + KNOX + STORM + SLIDER + FLUME + ACCUMULO + + + + + UPGRADE + + + + + + + + UPGRADE + + + + Please start previously stopped YARN queues. If yarn-site's yarn.resourcemanager.work-preserving-recovery.enabled is set to true, then you can skip this step since the clients will retry on their own. + + + + + + true + false + + + UPGRADE + + Please confirm you are ready to finalize. + + + + + + + finalize_non_rolling_upgrade + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + set_pre_start + + + + Upgrading Ranger database schema + + setup_ranger_database + + + + + + Applying Ranger java patches + + setup_ranger_java_patches + + + + + + + + + + + + + + + + + + + + + Upgrading Ranger KMS database schema + + setup_ranger_kms_database + + + + + + Downgrading Ranger KMS database schema + + setup_ranger_kms_database + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Upgrading the Oozie database and creating a new sharelib + + upgrade_oozie_database_and_sharelib + + + + + + Create a new sharelib + + create_sharelib + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Removing Storm data from ZooKeeper + + delete_storm_zookeeper_data + + + + Removing local Storm data + + delete_storm_local_data + + + + + + Removing Storm data from ZooKeeper + + delete_storm_zookeeper_data + + + + Removing local Storm data + + delete_storm_local_data + + + + + + + + + + + + Removing local Storm data + + delete_storm_local_data + + + + + + Before continuing, please deactivate and kill any currently running topologies. + + + + Removing local Storm data + + delete_storm_local_data + + + + + + + + + + + + Removing local Storm data + + delete_storm_local_data + + + + + + + + + + + + Removing local Storm data + + delete_storm_local_data + + + + + + + + + + Please rebuild your topology using the new Storm version dependencies and resubmit it using the newly created jar. + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +