Return-Path: X-Original-To: apmail-ranger-commits-archive@www.apache.org Delivered-To: apmail-ranger-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 175EE17BA7 for ; Sun, 22 Feb 2015 21:07:52 +0000 (UTC) Received: (qmail 98321 invoked by uid 500); 22 Feb 2015 21:07:52 -0000 Delivered-To: apmail-ranger-commits-archive@ranger.apache.org Received: (qmail 98296 invoked by uid 500); 22 Feb 2015 21:07:52 -0000 Mailing-List: contact commits-help@ranger.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ranger.incubator.apache.org Delivered-To: mailing list commits@ranger.incubator.apache.org Received: (qmail 98276 invoked by uid 99); 22 Feb 2015 21:07:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 22 Feb 2015 21:07:51 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD,WEIRD_PORT X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Sun, 22 Feb 2015 21:07:28 +0000 Received: (qmail 98188 invoked by uid 99); 22 Feb 2015 21:07:25 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 22 Feb 2015 21:07:25 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 2BBBEE0531; Sun, 22 Feb 2015 21:07:25 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: vel@apache.org To: commits@ranger.incubator.apache.org Date: Sun, 22 Feb 2015 21:07:25 -0000 Message-Id: X-Mailer: ASF-Git Admin Mailer Subject: [1/3] incubator-ranger git commit: RANGER-242: Fixed importing unnecessary properties for ranger plugin migration X-Virus-Checked: Checked by ClamAV on apache.org Repository: incubator-ranger Updated Branches: refs/heads/master 788897211 -> aedb1fc81 http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/bin/ranger_admin_install.properties ---------------------------------------------------------------------- diff --git a/migration-util/bin/ranger_admin_install.properties b/migration-util/bin/ranger_admin_install.properties index abc7ab0..321b6ea 100755 --- a/migration-util/bin/ranger_admin_install.properties +++ b/migration-util/bin/ranger_admin_install.properties @@ -17,6 +17,46 @@ # This file provides list of deployment variables for the Policy Manager Web Application # +# Below are the mandatory parameters, required to be filled in by the user. + +# +# DB password for the DB admin user-id +# ************************************************************************** +# ** If the password is left empty or not-defined here, +# ** it will be prompted to enter the password during installation process +# ************************************************************************** +# +#db_root_user=root +#db_root_user=SYS +# Mandatory properties for migration to be filled by user prior to migration. +# db_root_user = needs to be updated by user before running the migration script. +# db_root_password = needs to be updated by user before running the migration script. +db_root_user=root +db_root_password= +db_host=localhost + + +# +# UNIX authentication service for Policy Manager +# +# PolicyManager can authenticate using UNIX username/password +# The UNIX server specified here as authServiceHostName needs to be installed with xasecure-unix-ugsync package. +# Once the service is installed on authServiceHostName, the UNIX username/password from the host can be used to login into policy manager +# +# ** The installation of xasecure-unix-ugsync package can be installed after the policymanager installation is finished. +# +#LDAP|ACTIVE_DIRECTORY|UNIX|NONE +# Mandatory properties for migration to be filled by user prior to migration. +# authentication_method = needs to be updated by user before running the migration script. +authentication_method= +remoteLoginEnabled=true +authServiceHostName=localhost +authServicePort=5151 + + +# Below are the non-mandatory parameters, not required to be filled in by the user. + + #------------------------- DB CONFIG - BEGIN ---------------------------------- #DB_FLAVOR=ORACLE @@ -37,19 +77,6 @@ SQL_COMMAND_INVOKER='mysql' SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar -# -# DB password for the DB admin user-id -# ************************************************************************** -# ** If the password is left empty or not-defined here, -# ** it will be prompted to enter the password during installation process -# ************************************************************************** -# -#db_root_user=root -#db_root_user=SYS -# Mandatory properties for migration to be filled by user prior to migration. -db_root_user=root -db_root_password= -db_host=localhost # # DB UserId used for the XASecure schema @@ -93,20 +120,7 @@ unix_group=ranger # ------- UNIX User CONFIG - END ---------------- # -# -# UNIX authentication service for Policy Manager -# -# PolicyManager can authenticate using UNIX username/password -# The UNIX server specified here as authServiceHostName needs to be installed with xasecure-unix-ugsync package. -# Once the service is installed on authServiceHostName, the UNIX username/password from the host can be used to login into policy manager -# -# ** The installation of xasecure-unix-ugsync package can be installed after the policymanager installation is finished. -# -#LDAP|ACTIVE_DIRECTORY|UNIX|NONE -authentication_method=NONE -remoteLoginEnabled=true -authServiceHostName=localhost -authServicePort=5151 + ####LDAP settings - Required only if have selected LDAP authentication #### # http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/bin/ranger_hbase_plugin_install.properties ---------------------------------------------------------------------- diff --git a/migration-util/bin/ranger_hbase_plugin_install.properties b/migration-util/bin/ranger_hbase_plugin_install.properties index 36cd06f..e1df2fa 100755 --- a/migration-util/bin/ranger_hbase_plugin_install.properties +++ b/migration-util/bin/ranger_hbase_plugin_install.properties @@ -13,6 +13,37 @@ # See the License for the specific language governing permissions and # limitations under the License. + +# Below are the mandatory parameters, required to be filled in by the user. + +# +# This is the repository name created within policy manager +# +# Example: +# REPOSITORY_NAME=hbasedev +# +# Mandatory properties for migration to be filled by user prior to migration. +# REPOSITORY_NAME = needs to be updated by user before running the migration script. +REPOSITORY_NAME= + + + +# +# Should HBase GRANT/REVOKE update XA policies? +# +# Example: +# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=true +# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=false +# +# Mandatory property for migration to be filled by user prior to migration. +# UPDATE_XAPOLICIES_ON_GRANT_REVOKE = needs to be updated by user before running the migration script. +UPDATE_XAPOLICIES_ON_GRANT_REVOKE=True + + + +# Below are the non-mandatory parameters, not required to be filled in by the user. + + # # Location of Policy Manager URL # @@ -30,13 +61,7 @@ POLICY_MGR_URL=http://172.18.145.41:6080 # SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar -# -# This is the repository name created within policy manager -# -# Example: -# REPOSITORY_NAME=hbasedev -# -REPOSITORY_NAME=c1_hbase + # # AUDIT DB Configuration @@ -105,12 +130,4 @@ SSL_KEYSTORE_PASSWORD=myKeyFilePassword SSL_TRUSTSTORE_FILE_PATH=/etc/hbase/conf/ranger-plugin-truststore.jks SSL_TRUSTSTORE_PASSWORD=changeit -# -# Should HBase GRANT/REVOKE update XA policies? -# -# Example: -# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=true -# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=false -# -# Mandatory property for migration to be filled by user prior to migration. -UPDATE_XAPOLICIES_ON_GRANT_REVOKE=True + http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/bin/ranger_hdfs_plugin_install.properties ---------------------------------------------------------------------- diff --git a/migration-util/bin/ranger_hdfs_plugin_install.properties b/migration-util/bin/ranger_hdfs_plugin_install.properties index 93790e3..66b4dd5 100755 --- a/migration-util/bin/ranger_hdfs_plugin_install.properties +++ b/migration-util/bin/ranger_hdfs_plugin_install.properties @@ -13,6 +13,22 @@ # See the License for the specific language governing permissions and # limitations under the License. +# Below are the mandatory parameters, required to be filled in by the user. + +# +# This is the repository name created within policy manager +# +# Example: +# REPOSITORY_NAME=hadoopdev +# +# Mandatory properties for migration to be filled by user prior to migration. +# REPOSITORY_NAME = needs to be updated by user before running the migration script. +REPOSITORY_NAME= + + + +# Below are the non-mandatory parameters, not required to be filled in by the user. + # # Location of Policy Manager URL # @@ -30,13 +46,7 @@ POLICY_MGR_URL= # SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar -# -# This is the repository name created within policy manager -# -# Example: -# REPOSITORY_NAME=hadoopdev -# -REPOSITORY_NAME= + # # AUDIT DB Configuration http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/bin/ranger_hive_plugin_install.properties ---------------------------------------------------------------------- diff --git a/migration-util/bin/ranger_hive_plugin_install.properties b/migration-util/bin/ranger_hive_plugin_install.properties index 154e350..f4fbfd2 100755 --- a/migration-util/bin/ranger_hive_plugin_install.properties +++ b/migration-util/bin/ranger_hive_plugin_install.properties @@ -13,6 +13,37 @@ # See the License for the specific language governing permissions and # limitations under the License. + +# Below are the mandatory parameters, required to be filled in by the user. + +# +# This is the repository name created within policy manager +# +# Example: +# REPOSITORY_NAME=hivedev +# +# Mandatory properties for migration to be filled by user prior to migration. +# REPOSITORY_NAME = needs to be updated by user before running the migration script. +REPOSITORY_NAME= + + +# +# Should Hive GRANT/REVOKE update XA policies? +# +# Example: +# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=true +# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=false +# +# Mandatory property for migration to be filled by user prior to migration. +# UPDATE_XAPOLICIES_ON_GRANT_REVOKE = needs to be updated by user before running the migration script. +UPDATE_XAPOLICIES_ON_GRANT_REVOKE=true + + + + +# Below are the non-mandatory parameters, not required to be filled in by the user. + + # # Location of Policy Manager URL # @@ -30,13 +61,7 @@ POLICY_MGR_URL= # SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar -# -# This is the repository name created within policy manager -# -# Example: -# REPOSITORY_NAME=hivedev -# -REPOSITORY_NAME= + # # AUDIT DB Configuration @@ -105,12 +130,3 @@ SSL_KEYSTORE_PASSWORD=myKeyFilePassword SSL_TRUSTSTORE_FILE_PATH=/etc/hive/conf/ranger-plugin-truststore.jks SSL_TRUSTSTORE_PASSWORD=changeit -# -# Should Hive GRANT/REVOKE update XA policies? -# -# Example: -# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=true -# UPDATE_XAPOLICIES_ON_GRANT_REVOKE=false -# -# Mandatory property for migration to be filled by user prior to migration. -UPDATE_XAPOLICIES_ON_GRANT_REVOKE=true http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/bin/ranger_knox_plugin_install.properties ---------------------------------------------------------------------- diff --git a/migration-util/bin/ranger_knox_plugin_install.properties b/migration-util/bin/ranger_knox_plugin_install.properties index d821c5d..b314560 100755 --- a/migration-util/bin/ranger_knox_plugin_install.properties +++ b/migration-util/bin/ranger_knox_plugin_install.properties @@ -13,6 +13,25 @@ # See the License for the specific language governing permissions and # limitations under the License. + +# Below are the mandatory parameters, required to be filled in by the user. + + + +# +# This is the repository name created within policy manager +# +# Example: +# REPOSITORY_NAME=knoxdev +# +# Mandatory properties for migration to be filled by user prior to migration. +# REPOSITORY_NAME = needs to be updated by user before running the migration script. +REPOSITORY_NAME= + + +# Below are the non-mandatory parameters, not required to be filled in by the user. + + # # Location of Policy Manager URL # @@ -30,13 +49,7 @@ POLICY_MGR_URL= # SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar -# -# This is the repository name created within policy manager -# -# Example: -# REPOSITORY_NAME=knoxdev -# -REPOSITORY_NAME= + # KNOX_HOME directory, would contain conf/, ext/ subdirectories KNOX_HOME= http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/bin/ranger_storm_plugin_install.properties ---------------------------------------------------------------------- diff --git a/migration-util/bin/ranger_storm_plugin_install.properties b/migration-util/bin/ranger_storm_plugin_install.properties index 28a0fd7..9a289e8 100755 --- a/migration-util/bin/ranger_storm_plugin_install.properties +++ b/migration-util/bin/ranger_storm_plugin_install.properties @@ -13,6 +13,23 @@ # See the License for the specific language governing permissions and # limitations under the License. + +# Below are the mandatory parameters, required to be filled in by the user. + +# +# This is the repository name created within policy manager +# +# Example: +# REPOSITORY_NAME=stormdev +# +# Mandatory properties for migration to be filled by user prior to migration. +# REPOSITORY_NAME = needs to be updated by user before running the migration script. +REPOSITORY_NAME= + + +# Below are the non-mandatory parameters, not required to be filled in by the user. + + # # Location of Policy Manager URL # @@ -30,13 +47,7 @@ POLICY_MGR_URL= # SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java.jar -# -# This is the repository name created within policy manager -# -# Example: -# REPOSITORY_NAME=stormdev -# -REPOSITORY_NAME= + # # AUDIT DB Configuration http://git-wip-us.apache.org/repos/asf/incubator-ranger/blob/aedb1fc8/migration-util/doc/README.TXT ---------------------------------------------------------------------- diff --git a/migration-util/doc/README.TXT b/migration-util/doc/README.TXT index 31a031d..50ecc10 100644 --- a/migration-util/doc/README.TXT +++ b/migration-util/doc/README.TXT @@ -34,7 +34,7 @@ Steps to Add Ranger in a Ambari HDP cluster: python import_ranger_to_ambari.py * Migration script locates the existing config in post-install properties files used by the service. * This script will collect required configs from the independently installed Ranger service configurations - and post it to the specified Ambari Server. + and after verification from the user, post it to the specified Ambari Server. * Set appropriate values in the respective install.properties template file, only if required. For Ranger Admin service, ranger_admin_install.properties For Ranger Usersync service, ranger_usersync_install.properties @@ -44,9 +44,10 @@ Steps to Add Ranger in a Ambari HDP cluster: For Ranger Knox plugin, ranger_knox_plugin_install.properties For Ranger Storm plugin, ranger_storm_plugin_install.properties * For script to use proper values, mandatory properties to be filled by user are as follows : - 1) During Ranger_Admin installation migration, the db root username and password are mandatory, + 1) During Ranger_Admin installation migration, the authentication_method , db_root_username and db_root_password are mandatory, which can be set in the ranger_admin_install.properties - 2) During HBase and Hive Plugin migration,a flag called UPDATE_XAPOLICIES_ON_GRANT_REVOKE is used to save policies during grant-revoke operations. + 2) During Hdfs , Knox and Storm Plugin Migration parameter repository_name is mandatory and should be filled in ranger_hdfs_plugin_install.properties , ranger_knox_plugin_install.properties or ranger_storm_plugin_install.properties before running script for installing the particular component. + 3) During HBase and Hive Plugin migration,parameters repository name and UPDATE_XAPOLICIES_ON_GRANT_REVOKE is used to save policies during grant-revoke operations. Hence this flag should be set by user in ranger_hbase_plugin_install.properties or ranger_hive_plugin_install.properties respectively. To import Ranger (Admin and User-Sync) service and plugins we need to run the python script using command line as shown below,