Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 13AB5200B45 for ; Thu, 9 Jun 2016 17:01:31 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 12995160A58; Thu, 9 Jun 2016 15:01:31 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7C4CF160A60 for ; Thu, 9 Jun 2016 17:01:28 +0200 (CEST) Received: (qmail 48675 invoked by uid 500); 9 Jun 2016 15:01:27 -0000 Mailing-List: contact commits-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: ambari-dev@ambari.apache.org Delivered-To: mailing list commits@ambari.apache.org Received: (qmail 47894 invoked by uid 99); 9 Jun 2016 15:01:26 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Jun 2016 15:01:26 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id B8FA7E07F6; Thu, 9 Jun 2016 15:01:26 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: dmitriusan@apache.org To: commits@ambari.apache.org Date: Thu, 09 Jun 2016 15:01:35 -0000 Message-Id: <4b2ff8b199fb474d96b0b82a815308e2@git.apache.org> In-Reply-To: <1f690137a0d04f40a98aa60925acb588@git.apache.org> References: <1f690137a0d04f40a98aa60925acb588@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [10/70] ambari git commit: AMBARI-17112. Fixed implementation of on-ambari-upgrade support. Update all stack configuration xmls to pass validation. Change defaults (dlysnichenko) archived-at: Thu, 09 Jun 2016 15:01:31 -0000 http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml index 6f96077..34960a9 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml @@ -28,28 +28,28 @@ of directories then the name table is replicated in all of the directories, for redundancy. true - + dfs.support.append true to enable dfs append true - + dfs.webhdfs.enabled false to enable webhdfs true - + dfs.datanode.failed.volumes.tolerated 0 #of failed disks dn would tolerate true - + dfs.block.local-path-access.user @@ -58,7 +58,7 @@ circuit reads. true - + dfs.data.dir @@ -70,7 +70,7 @@ Directories that do not exist are ignored. true - + dfs.hosts.exclude @@ -79,7 +79,7 @@ not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded. - + dfs.hosts @@ -88,27 +88,27 @@ permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, all hosts are permitted. - + dfs.replication.max 50 Maximal block replication. - + dfs.replication 3 Default block replication. - + dfs.heartbeat.interval 3 Determines datanode heartbeat interval in seconds. - + dfs.safemode.threshold.pct @@ -119,7 +119,7 @@ Values less than or equal to 0 mean not to start in safe mode. Values greater than 1 will make safe mode permanent. - + dfs.balance.bandwidthPerSec @@ -129,23 +129,23 @@ can utilize for the balancing purpose in term of the number of bytes per second. - + dfs.datanode.address 0.0.0.0:50010 - + dfs.datanode.http.address 0.0.0.0:50075 - + dfs.block.size 134217728 The default block size for new files. - + dfs.http.address @@ -153,7 +153,7 @@ The name of the default file system. Either the literal string "local" or a host:port for HDFS. true - + dfs.datanode.du.reserved @@ -161,7 +161,7 @@ literal string "local" or a host:port for HDFS. 1073741824 Reserved space in bytes per volume. Always leave this much space free for non dfs use. - + dfs.datanode.ipc.address @@ -170,25 +170,25 @@ literal string "local" or a host:port for HDFS. The datanode ipc server address and port. If the port is 0 then the server will start on a free port. - + dfs.blockreport.initialDelay 120 Delay for first block report in seconds. - + dfs.namenode.handler.count 40 The number of server threads for the namenode. - + dfs.datanode.max.xcievers 1024 PRIVATE CONFIG VARIABLE - + @@ -197,7 +197,7 @@ If the port is 0 then the server will start on a free port. The octal umask used when creating files and directories. - + dfs.web.ugi @@ -206,7 +206,7 @@ The octal umask used when creating files and directories. The user account used by the web interface. Syntax: USERNAME,GROUP1,GROUP2, ... - + dfs.permissions @@ -218,24 +218,24 @@ but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories. - + dfs.permissions.supergroup hdfs The name of the group of super-users. - + dfs.namenode.handler.count 100 Added to grow Queue size so that more client connections are allowed - + ipc.server.max.response.size 5242880 - + dfs.block.access.token.enable @@ -244,7 +244,7 @@ owner or group of files or directories. If "true", access tokens are used as capabilities for accessing datanodes. If "false", no access tokens are checked on accessing datanodes. - + dfs.namenode.kerberos.principal @@ -252,7 +252,7 @@ If "false", no access tokens are checked on accessing datanodes. Kerberos principal name for the NameNode - + dfs.secondary.namenode.kerberos.principal @@ -260,7 +260,7 @@ Kerberos principal name for the NameNode Kerberos principal name for the secondary NameNode. - + dfs.secondary.http.address hdp2.cybervisiontech.com.ua:50090 Address of secondary namenode web server - + dfs.secondary.https.port 50490 The https port where secondary-namenode binds - + dfs.web.authentication.kerberos.principal @@ -298,7 +298,7 @@ Kerberos principal name for the NameNode The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos HTTP SPENGO specification. - + dfs.web.authentication.kerberos.keytab @@ -307,7 +307,7 @@ Kerberos principal name for the NameNode The Kerberos keytab file with the credentials for the HTTP Kerberos principal used by Hadoop-Auth in the HTTP endpoint. - + dfs.datanode.kerberos.principal @@ -315,7 +315,7 @@ Kerberos principal name for the NameNode The Kerberos principal that the DataNode runs as. "_HOST" is replaced by the real host name. - + dfs.namenode.keytab.file @@ -323,7 +323,7 @@ Kerberos principal name for the NameNode Combined keytab file containing the namenode service and host principals. - + dfs.secondary.namenode.keytab.file @@ -331,7 +331,7 @@ Kerberos principal name for the NameNode Combined keytab file containing the namenode service and host principals. - + dfs.datanode.keytab.file @@ -339,19 +339,19 @@ Kerberos principal name for the NameNode The filename of the keytab file for the DataNode. - + dfs.https.port 50470 The https port where namenode binds - + dfs.https.address hdp1.cybervisiontech.com.ua:50470 The https address where namenode binds - + dfs.datanode.data.dir.perm @@ -360,7 +360,7 @@ Kerberos principal name for the NameNode directories. The datanode will not come up if the permissions are different on existing dfs.data.dir directories. If the directories don't exist, they will be created with this permission. - + dfs.access.time.precision @@ -369,18 +369,18 @@ don't exist, they will be created with this permission. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. - + dfs.cluster.administrators hdfs ACL for who all can view the default servlets in the HDFS - + ipc.server.read.threadpool.size 5 - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml index 8a4f566..257e045 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml @@ -28,28 +28,28 @@ of directories then the name table is replicated in all of the directories, for redundancy. true - + dfs.support.append true to enable dfs append true - + dfs.webhdfs.enabled false to enable webhdfs true - + dfs.datanode.failed.volumes.tolerated 0 #of failed disks dn would tolerate true - + dfs.block.local-path-access.user @@ -58,7 +58,7 @@ circuit reads. true - + dfs.data.dir @@ -70,7 +70,7 @@ Directories that do not exist are ignored. true - + dfs.hosts.exclude @@ -79,7 +79,7 @@ not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded. - + dfs.hosts @@ -88,27 +88,27 @@ permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, all hosts are permitted. - + dfs.replication.max 50 Maximal block replication. - + dfs.replication 3 Default block replication. - + dfs.heartbeat.interval 3 Determines datanode heartbeat interval in seconds. - + dfs.safemode.threshold.pct @@ -119,7 +119,7 @@ Values less than or equal to 0 mean not to start in safe mode. Values greater than 1 will make safe mode permanent. - + dfs.balance.bandwidthPerSec @@ -129,25 +129,25 @@ can utilize for the balancing purpose in term of the number of bytes per second. - + dfs.datanode.address 0.0.0.0:50010 Address where the datanode binds - + dfs.datanode.http.address 0.0.0.0:50075 HTTP address for the datanode - + dfs.block.size 134217728 The default block size for new files. - + dfs.http.address @@ -155,7 +155,7 @@ The name of the default file system. Either the literal string "local" or a host:port for HDFS. true - + dfs.datanode.du.reserved @@ -163,7 +163,7 @@ literal string "local" or a host:port for HDFS. 1073741824 Reserved space in bytes per volume. Always leave this much space free for non dfs use. - + dfs.datanode.ipc.address @@ -172,25 +172,25 @@ literal string "local" or a host:port for HDFS. The datanode ipc server address and port. If the port is 0 then the server will start on a free port. - + dfs.blockreport.initialDelay 120 Delay for first block report in seconds. - + dfs.namenode.handler.count 40 The number of server threads for the namenode. - + dfs.datanode.max.xcievers 1024 PRIVATE CONFIG VARIABLE - + @@ -199,7 +199,7 @@ If the port is 0 then the server will start on a free port. The octal umask used when creating files and directories. - + dfs.web.ugi @@ -208,7 +208,7 @@ The octal umask used when creating files and directories. The user account used by the web interface. Syntax: USERNAME,GROUP1,GROUP2, ... - + dfs.permissions @@ -220,25 +220,25 @@ but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories. - + dfs.permissions.supergroup hdfs The name of the group of super-users. - + dfs.namenode.handler.count 100 Added to grow Queue size so that more client connections are allowed - + ipc.server.max.response.size 5242880 The max response size for IPC - + dfs.block.access.token.enable @@ -247,7 +247,7 @@ owner or group of files or directories. If "true", access tokens are used as capabilities for accessing datanodes. If "false", no access tokens are checked on accessing datanodes. - + dfs.namenode.kerberos.principal @@ -255,7 +255,7 @@ If "false", no access tokens are checked on accessing datanodes. Kerberos principal name for the NameNode - + dfs.secondary.namenode.kerberos.principal @@ -263,7 +263,7 @@ Kerberos principal name for the NameNode Kerberos principal name for the secondary NameNode. - + dfs.secondary.http.address hdp2.cybervisiontech.com.ua:50090 Address of secondary namenode web server - + dfs.secondary.https.port 50490 The https port where secondary-namenode binds - + dfs.web.authentication.kerberos.principal @@ -301,7 +301,7 @@ Kerberos principal name for the NameNode The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos HTTP SPENGO specification. - + dfs.web.authentication.kerberos.keytab @@ -310,7 +310,7 @@ Kerberos principal name for the NameNode The Kerberos keytab file with the credentials for the HTTP Kerberos principal used by Hadoop-Auth in the HTTP endpoint. - + dfs.datanode.kerberos.principal @@ -318,7 +318,7 @@ Kerberos principal name for the NameNode The Kerberos principal that the DataNode runs as. "_HOST" is replaced by the real host name. - + dfs.namenode.keytab.file @@ -326,7 +326,7 @@ Kerberos principal name for the NameNode Combined keytab file containing the namenode service and host principals. - + dfs.secondary.namenode.keytab.file @@ -334,7 +334,7 @@ Kerberos principal name for the NameNode Combined keytab file containing the namenode service and host principals. - + dfs.datanode.keytab.file @@ -342,19 +342,19 @@ Kerberos principal name for the NameNode The filename of the keytab file for the DataNode. - + dfs.https.port 50470 The https port where namenode binds - + dfs.https.address hdp1.cybervisiontech.com.ua:50470 The https address where namenode binds - + dfs.datanode.data.dir.perm @@ -363,7 +363,7 @@ Kerberos principal name for the NameNode directories. The datanode will not come up if the permissions are different on existing dfs.data.dir directories. If the directories don't exist, they will be created with this permission. - + dfs.access.time.precision @@ -372,18 +372,18 @@ don't exist, they will be created with this permission. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. - + dfs.cluster.administrators hdfs ACL for who all can view the default servlets in the HDFS - + ipc.server.read.threadpool.size 5 IPC thread size - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml index afe544c..1d56933 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml @@ -29,14 +29,14 @@ in milliseconds. Default is 15. Set this value low if you want unit tests to be responsive. - + hbase.client.pause 5000 General client pause value. Used mostly as value to wait before running a retry of a failed get, region lookup, etc. - + hbase.master.meta.thread.rescanfrequency @@ -44,7 +44,7 @@ How long the HMaster sleeps (in milliseconds) between scans of the root and meta tables. - + hbase.server.thread.wakefrequency @@ -52,7 +52,7 @@ Time to sleep in between searches for work (in milliseconds). Used as sleep interval by service threads such as META scanner and log roller. - + hbase.regionserver.handler.count @@ -61,7 +61,7 @@ Same property is used by the HMaster for count of master handlers. Default is 10. - + hbase.master.lease.period @@ -71,7 +71,7 @@ value has been reduced so that the master will notice a dead region server sooner. The default is 30 seconds. - + hbase.master.info.port @@ -79,7 +79,7 @@ The port for the hbase master web UI Set to -1 if you do not want the info server to run. - + hbase.regionserver.info.port @@ -87,7 +87,7 @@ The port for the hbase regionserver web UI Set to -1 if you do not want the info server to run. - + hbase.regionserver.info.port.auto @@ -96,7 +96,7 @@ search if hbase.regionserver.info.port is already in use. Enabled for testing to run multiple tests on one machine. - + hbase.master.lease.thread.wakefrequency @@ -105,7 +105,7 @@ This value has been reduced due to the other reduced values above so that the master will notice a dead region server sooner. The default is 15 seconds. - + hbase.regionserver.optionalcacheflushinterval @@ -114,7 +114,7 @@ Amount of time to wait since the last time a region was flushed before invoking an optional cache flush. Default 60,000. - + hbase.regionserver.safemode @@ -123,7 +123,7 @@ Turn on/off safe mode in region server. Always on for production, always off for tests. - + hbase.hregion.max.filesize @@ -134,12 +134,12 @@ Keep the maximum filesize small so we split more often in tests. - + hadoop.log.dir ${user.dir}/../logs - + hbase.zookeeper.property.clientPort @@ -147,6 +147,6 @@ Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml index 2c0aeca..0ff88b5 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml @@ -24,144 +24,144 @@ namenode_host NameNode Host. - + dfs_name_dir /hadoop/hdfs/namenode NameNode Directories. - + snamenode_host Secondary NameNode. - + fs_checkpoint_dir /hadoop/hdfs/namesecondary Secondary NameNode checkpoint dir. - + datanode_hosts List of Datanode Hosts. - + dfs_data_dir /hadoop/hdfs/data Data directories for Data Nodes. - + hdfs_log_dir_prefix /var/log/hadoop Hadoop Log Dir Prefix - + hadoop_pid_dir_prefix /var/run/hadoop Hadoop PID Dir Prefix - + dfs_webhdfs_enabled true WebHDFS enabled - + hadoop_heapsize 1024 Hadoop maximum Java heap size - + namenode_heapsize 1024 NameNode Java heap size - + namenode_opt_newsize 200 Default size of Java new generation for NameNode (Java option -XX:NewSize) Note: The value of NameNode new generation size (default size of Java new generation for NameNode (Java option -XX:NewSize)) should be 1/8 of maximum heap size (-Xmx). Ensure that the value of the namenode_opt_newsize property is 1/8 the value of maximum heap size (-Xmx). - + namenode_opt_maxnewsize 640 NameNode maximum new generation size - + namenode_opt_permsize 128 NameNode permanent generation size - + namenode_opt_maxpermsize 256 NameNode maximum permanent generation size - + datanode_du_reserved 1 Reserved space for HDFS - + dtnode_heapsize 1024 DataNode maximum Java heap size - + dfs_datanode_failed_volume_tolerated 0 DataNode volumes failure toleration - + fs_checkpoint_period 21600 HDFS Maximum Checkpoint Delay - + fs_checkpoint_size 0.5 FS Checkpoint Size. - + security_enabled false Hadoop Security - + kerberos_domain EXAMPLE.COM Kerberos realm. - + kerberos_domain EXAMPLE.COM Kerberos realm. - + keytab_path /etc/security/keytabs KeyTab Directory. - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml index fe81067..228b2e0 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml @@ -24,55 +24,55 @@ hdfs_log_dir_prefix /var/log/hadoop Hadoop Log Dir Prefix - + hadoop_pid_dir_prefix /var/run/hadoop Hadoop PID Dir Prefix - + hadoop_heapsize 1024 Hadoop maximum Java heap size - + namenode_heapsize 1024 NameNode Java heap size - + namenode_opt_newsize 200 Default size of Java new generation for NameNode (Java option -XX:NewSize) Note: The value of NameNode new generation size (default size of Java new generation for NameNode (Java option -XX:NewSize)) should be 1/8 of maximum heap size (-Xmx). Ensure that the value of the namenode_opt_newsize property is 1/8 the value of maximum heap size (-Xmx). - + namenode_opt_maxnewsize 200 NameNode maximum new generation size - + namenode_opt_permsize 128 NameNode permanent generation size - + namenode_opt_maxpermsize 256 NameNode maximum permanent generation size - + dtnode_heapsize 1024 DataNode maximum Java heap size - + proxyuser_group @@ -82,46 +82,46 @@ false - + security_enabled false Hadoop Security - + kerberos_domain EXAMPLE.COM Kerberos realm. - + hdfs_user

HDFS User

hdfs User and Groups. - + ignore_groupsusers_create false Whether to ignores failures on users and group creation - + smokeuser

Smoke User

ambari-qa User executing service checks - + user_group

Hadoop Group

hadoop Proxy user group. - + @@ -242,6 +242,6 @@ export JAVA_LIBRARY_PATH=${JAVA_LIBRARY_PATH}:/usr/lib/hadoop/lib/native/Linux-a content - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml index afe544c..1d56933 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml @@ -29,14 +29,14 @@ in milliseconds. Default is 15. Set this value low if you want unit tests to be responsive. - + hbase.client.pause 5000 General client pause value. Used mostly as value to wait before running a retry of a failed get, region lookup, etc. - + hbase.master.meta.thread.rescanfrequency @@ -44,7 +44,7 @@ How long the HMaster sleeps (in milliseconds) between scans of the root and meta tables. - + hbase.server.thread.wakefrequency @@ -52,7 +52,7 @@ Time to sleep in between searches for work (in milliseconds). Used as sleep interval by service threads such as META scanner and log roller. - + hbase.regionserver.handler.count @@ -61,7 +61,7 @@ Same property is used by the HMaster for count of master handlers. Default is 10. - + hbase.master.lease.period @@ -71,7 +71,7 @@ value has been reduced so that the master will notice a dead region server sooner. The default is 30 seconds. - + hbase.master.info.port @@ -79,7 +79,7 @@ The port for the hbase master web UI Set to -1 if you do not want the info server to run. - + hbase.regionserver.info.port @@ -87,7 +87,7 @@ The port for the hbase regionserver web UI Set to -1 if you do not want the info server to run. - + hbase.regionserver.info.port.auto @@ -96,7 +96,7 @@ search if hbase.regionserver.info.port is already in use. Enabled for testing to run multiple tests on one machine. - + hbase.master.lease.thread.wakefrequency @@ -105,7 +105,7 @@ This value has been reduced due to the other reduced values above so that the master will notice a dead region server sooner. The default is 15 seconds. - + hbase.regionserver.optionalcacheflushinterval @@ -114,7 +114,7 @@ Amount of time to wait since the last time a region was flushed before invoking an optional cache flush. Default 60,000. - + hbase.regionserver.safemode @@ -123,7 +123,7 @@ Turn on/off safe mode in region server. Always on for production, always off for tests. - + hbase.hregion.max.filesize @@ -134,12 +134,12 @@ Keep the maximum filesize small so we split more often in tests. - + hadoop.log.dir ${user.dir}/../logs - + hbase.zookeeper.property.clientPort @@ -147,6 +147,6 @@ Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml index af8f5ba..f97236d 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml @@ -195,6 +195,6 @@ log4j.logger.org.apache.hadoop.conf.Configuration.deprecation=WARN content - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-site.xml index 6f96077..34960a9 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-site.xml @@ -28,28 +28,28 @@ of directories then the name table is replicated in all of the directories, for redundancy. true - + dfs.support.append true to enable dfs append true - + dfs.webhdfs.enabled false to enable webhdfs true - + dfs.datanode.failed.volumes.tolerated 0 #of failed disks dn would tolerate true - + dfs.block.local-path-access.user @@ -58,7 +58,7 @@ circuit reads. true - + dfs.data.dir @@ -70,7 +70,7 @@ Directories that do not exist are ignored. true - + dfs.hosts.exclude @@ -79,7 +79,7 @@ not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded. - + dfs.hosts @@ -88,27 +88,27 @@ permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, all hosts are permitted. - + dfs.replication.max 50 Maximal block replication. - + dfs.replication 3 Default block replication. - + dfs.heartbeat.interval 3 Determines datanode heartbeat interval in seconds. - + dfs.safemode.threshold.pct @@ -119,7 +119,7 @@ Values less than or equal to 0 mean not to start in safe mode. Values greater than 1 will make safe mode permanent. - + dfs.balance.bandwidthPerSec @@ -129,23 +129,23 @@ can utilize for the balancing purpose in term of the number of bytes per second. - + dfs.datanode.address 0.0.0.0:50010 - + dfs.datanode.http.address 0.0.0.0:50075 - + dfs.block.size 134217728 The default block size for new files. - + dfs.http.address @@ -153,7 +153,7 @@ The name of the default file system. Either the literal string "local" or a host:port for HDFS. true - + dfs.datanode.du.reserved @@ -161,7 +161,7 @@ literal string "local" or a host:port for HDFS. 1073741824 Reserved space in bytes per volume. Always leave this much space free for non dfs use. - + dfs.datanode.ipc.address @@ -170,25 +170,25 @@ literal string "local" or a host:port for HDFS. The datanode ipc server address and port. If the port is 0 then the server will start on a free port. - + dfs.blockreport.initialDelay 120 Delay for first block report in seconds. - + dfs.namenode.handler.count 40 The number of server threads for the namenode. - + dfs.datanode.max.xcievers 1024 PRIVATE CONFIG VARIABLE - + @@ -197,7 +197,7 @@ If the port is 0 then the server will start on a free port. The octal umask used when creating files and directories. - + dfs.web.ugi @@ -206,7 +206,7 @@ The octal umask used when creating files and directories. The user account used by the web interface. Syntax: USERNAME,GROUP1,GROUP2, ... - + dfs.permissions @@ -218,24 +218,24 @@ but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories. - + dfs.permissions.supergroup hdfs The name of the group of super-users. - + dfs.namenode.handler.count 100 Added to grow Queue size so that more client connections are allowed - + ipc.server.max.response.size 5242880 - + dfs.block.access.token.enable @@ -244,7 +244,7 @@ owner or group of files or directories. If "true", access tokens are used as capabilities for accessing datanodes. If "false", no access tokens are checked on accessing datanodes. - + dfs.namenode.kerberos.principal @@ -252,7 +252,7 @@ If "false", no access tokens are checked on accessing datanodes. Kerberos principal name for the NameNode - + dfs.secondary.namenode.kerberos.principal @@ -260,7 +260,7 @@ Kerberos principal name for the NameNode Kerberos principal name for the secondary NameNode. - + dfs.secondary.http.address hdp2.cybervisiontech.com.ua:50090 Address of secondary namenode web server - + dfs.secondary.https.port 50490 The https port where secondary-namenode binds - + dfs.web.authentication.kerberos.principal @@ -298,7 +298,7 @@ Kerberos principal name for the NameNode The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos HTTP SPENGO specification. - + dfs.web.authentication.kerberos.keytab @@ -307,7 +307,7 @@ Kerberos principal name for the NameNode The Kerberos keytab file with the credentials for the HTTP Kerberos principal used by Hadoop-Auth in the HTTP endpoint. - + dfs.datanode.kerberos.principal @@ -315,7 +315,7 @@ Kerberos principal name for the NameNode The Kerberos principal that the DataNode runs as. "_HOST" is replaced by the real host name. - + dfs.namenode.keytab.file @@ -323,7 +323,7 @@ Kerberos principal name for the NameNode Combined keytab file containing the namenode service and host principals. - + dfs.secondary.namenode.keytab.file @@ -331,7 +331,7 @@ Kerberos principal name for the NameNode Combined keytab file containing the namenode service and host principals. - + dfs.datanode.keytab.file @@ -339,19 +339,19 @@ Kerberos principal name for the NameNode The filename of the keytab file for the DataNode. - + dfs.https.port 50470 The https port where namenode binds - + dfs.https.address hdp1.cybervisiontech.com.ua:50470 The https address where namenode binds - + dfs.datanode.data.dir.perm @@ -360,7 +360,7 @@ Kerberos principal name for the NameNode directories. The datanode will not come up if the permissions are different on existing dfs.data.dir directories. If the directories don't exist, they will be created with this permission. - + dfs.access.time.precision @@ -369,18 +369,18 @@ don't exist, they will be created with this permission. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. - + dfs.cluster.administrators hdfs ACL for who all can view the default servlets in the HDFS - + ipc.server.read.threadpool.size 5 - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/global.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/global.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/global.xml index b357c52..aaeb55c 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/global.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/global.xml @@ -24,162 +24,162 @@ jobtracker_host JobTracker Host. - + tasktracker_hosts TaskTracker hosts. - + mapred_local_dir /hadoop/mapred MapRed Local Directories. - + mapred_system_dir /mapred/system MapRed System Directories. - + scheduler_name org.apache.hadoop.mapred.CapacityTaskScheduler MapRed Capacity Scheduler. - + jtnode_opt_newsize 200 Mem New Size. - + jtnode_opt_maxnewsize 200 Max New size. - + hadoop_heapsize 1024 Hadoop maximum Java heap size - + jtnode_heapsize 1024 Maximum Java heap size for JobTracker in MB (Java option -Xmx) - + mapred_map_tasks_max 4 Number of slots that Map tasks that run simultaneously can occupy on a TaskTracker - + mapred_red_tasks_max 2 Number of slots that Reduce tasks that run simultaneously can occupy on a TaskTracker - + mapred_cluster_map_mem_mb -1 The virtual memory size of a single Map slot in the MapReduce framework - + mapred_cluster_red_mem_mb -1 The virtual memory size of a single Reduce slot in the MapReduce framework - + mapred_job_map_mem_mb -1 Virtual memory for single Map task - + mapred_child_java_opts_sz 768 Java options for the TaskTracker child processes. - + io_sort_mb 200 The total amount of Map-side buffer memory to use while sorting files (Expert-only configuration). - + io_sort_spill_percent 0.9 Percentage of sort buffer used for record collection (Expert-only configuration. - + mapreduce_userlog_retainhours 24 The maximum time, in hours, for which the user-logs are to be retained after the job completion. - + maxtasks_per_job -1 Maximum number of tasks for a single Job - + lzo_enabled false LZO compression enabled - + snappy_enabled true LZO compression enabled - + rca_enabled true Enable Job Diagnostics. - + mapred_hosts_exclude Exclude entered hosts - + mapred_hosts_include Include entered hosts - + mapred_jobstatus_dir file:////mapred/jobstatus Job Status directory - + task_controller org.apache.hadoop.mapred.DefaultTaskController Task Controller. - + mapred_user mapred MapReduce User. - + http://git-wip-us.apache.org/repos/asf/ambari/blob/fa1b536d/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/hbase-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/hbase-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/hbase-site.xml index afe544c..1d56933 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/hbase-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/MAPREDUCE/configuration/hbase-site.xml @@ -29,14 +29,14 @@ in milliseconds. Default is 15. Set this value low if you want unit tests to be responsive. - + hbase.client.pause 5000 General client pause value. Used mostly as value to wait before running a retry of a failed get, region lookup, etc. - + hbase.master.meta.thread.rescanfrequency @@ -44,7 +44,7 @@ How long the HMaster sleeps (in milliseconds) between scans of the root and meta tables. - + hbase.server.thread.wakefrequency @@ -52,7 +52,7 @@ Time to sleep in between searches for work (in milliseconds). Used as sleep interval by service threads such as META scanner and log roller. - + hbase.regionserver.handler.count @@ -61,7 +61,7 @@ Same property is used by the HMaster for count of master handlers. Default is 10. - + hbase.master.lease.period @@ -71,7 +71,7 @@ value has been reduced so that the master will notice a dead region server sooner. The default is 30 seconds. - + hbase.master.info.port @@ -79,7 +79,7 @@ The port for the hbase master web UI Set to -1 if you do not want the info server to run. - + hbase.regionserver.info.port @@ -87,7 +87,7 @@ The port for the hbase regionserver web UI Set to -1 if you do not want the info server to run. - + hbase.regionserver.info.port.auto @@ -96,7 +96,7 @@ search if hbase.regionserver.info.port is already in use. Enabled for testing to run multiple tests on one machine. - + hbase.master.lease.thread.wakefrequency @@ -105,7 +105,7 @@ This value has been reduced due to the other reduced values above so that the master will notice a dead region server sooner. The default is 15 seconds. - + hbase.regionserver.optionalcacheflushinterval @@ -114,7 +114,7 @@ Amount of time to wait since the last time a region was flushed before invoking an optional cache flush. Default 60,000. - + hbase.regionserver.safemode @@ -123,7 +123,7 @@ Turn on/off safe mode in region server. Always on for production, always off for tests. - + hbase.hregion.max.filesize @@ -134,12 +134,12 @@ Keep the maximum filesize small so we split more often in tests. - + hadoop.log.dir ${user.dir}/../logs - + hbase.zookeeper.property.clientPort @@ -147,6 +147,6 @@ Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. - +