Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A3DEC200B41 for ; Thu, 2 Jun 2016 03:59:20 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A27DD160A5A; Thu, 2 Jun 2016 01:59:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 36BDE160A64 for ; Thu, 2 Jun 2016 03:59:16 +0200 (CEST) Received: (qmail 92740 invoked by uid 500); 2 Jun 2016 01:59:12 -0000 Mailing-List: contact commits-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: ambari-dev@ambari.apache.org Delivered-To: mailing list commits@ambari.apache.org Received: (qmail 90328 invoked by uid 99); 2 Jun 2016 01:59:10 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jun 2016 01:59:10 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 2EC6AE383A; Thu, 2 Jun 2016 01:59:10 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: srimanth@apache.org To: commits@ambari.apache.org Date: Thu, 02 Jun 2016 02:00:12 -0000 Message-Id: In-Reply-To: <2a998c05c597409fbcd3db1c77f1c580@git.apache.org> References: <2a998c05c597409fbcd3db1c77f1c580@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [65/98] [abbrv] ambari git commit: Revert "AMBARI-16272. Ambari Upgrade shouldn't automatically add stack configs (dlysnichenko)" - failing testcases archived-at: Thu, 02 Jun 2016 01:59:20 -0000 http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml index 759cbcb..995f6c1 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/hdfs-site.xml @@ -1,5 +1,6 @@ + + + - + + + dfs.name.dir @@ -28,33 +33,29 @@ of directories then the name table is replicated in all of the directories, for redundancy. true - - + dfs.support.append true to enable dfs append true - - + dfs.webhdfs.enabled false to enable webhdfs true - - + dfs.datanode.failed.volumes.tolerated 0 #of failed disks dn would tolerate true - - + dfs.block.local-path-access.user hbase @@ -62,9 +63,8 @@ circuit reads. true - - + dfs.data.dir /mnt/hmc/hadoop/hdfs/data @@ -75,9 +75,8 @@ Directories that do not exist are ignored. true - - + dfs.hosts.exclude /etc/hadoop/conf/dfs.exclude @@ -85,9 +84,8 @@ not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded. - - + dfs.hosts /etc/hadoop/conf/dfs.include @@ -95,32 +93,28 @@ permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, all hosts are permitted. - - + dfs.replication.max 50 Maximal block replication. - - + dfs.replication 3 Default block replication. - - + dfs.heartbeat.interval 3 Determines datanode heartbeat interval in seconds. - - + dfs.safemode.threshold.pct 1.0f @@ -130,9 +124,8 @@ Values less than or equal to 0 mean not to start in safe mode. Values greater than 1 will make safe mode permanent. - - + dfs.balance.bandwidthPerSec 6250000 @@ -141,190 +134,170 @@ can utilize for the balancing purpose in term of the number of bytes per second. - - + dfs.datanode.address 0.0.0.0:50010 - - + dfs.datanode.http.address 0.0.0.0:50075 - - + dfs.block.size 134217728 The default block size for new files. - - + dfs.http.address hdp1.cybervisiontech.com.ua:50070 - The name of the default file system. Either the +The name of the default file system. Either the literal string "local" or a host:port for HDFS. - true - - - - - dfs.datanode.du.reserved - - 1073741824 - Reserved space in bytes per volume. Always leave this much space free for non dfs use. +true + + + +dfs.datanode.du.reserved + +1073741824 +Reserved space in bytes per volume. Always leave this much space free for non dfs use. - - - - - dfs.datanode.ipc.address - 0.0.0.0:8010 - + + + +dfs.datanode.ipc.address +0.0.0.0:8010 + The datanode ipc server address and port. If the port is 0 then the server will start on a free port. - - - - - dfs.blockreport.initialDelay - 120 - Delay for first block report in seconds. - - - - - dfs.namenode.handler.count - 40 - The number of server threads for the namenode. - - - - - dfs.datanode.max.xcievers - 1024 - PRIVATE CONFIG VARIABLE - - - - - - dfs.umaskmode - 077 - + + + +dfs.blockreport.initialDelay +120 +Delay for first block report in seconds. + + + +dfs.namenode.handler.count +40 +The number of server threads for the namenode. + + + +dfs.datanode.max.xcievers +1024 +PRIVATE CONFIG VARIABLE + + + + + +dfs.umaskmode +077 + The octal umask used when creating files and directories. - - - - - dfs.web.ugi - - gopher,gopher - The user account used by the web interface. + + + +dfs.web.ugi + +gopher,gopher +The user account used by the web interface. Syntax: USERNAME,GROUP1,GROUP2, ... - - - - - dfs.permissions - true - + + + +dfs.permissions +true + If "true", enable permission checking in HDFS. If "false", permission checking is turned off, but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories. - - - - - dfs.permissions.supergroup - hdfs - The name of the group of super-users. - - - - - dfs.namenode.handler.count - 100 - Added to grow Queue size so that more client connections are allowed - - - - - ipc.server.max.response.size - 5242880 - - - - - dfs.block.access.token.enable - true - + + + +dfs.permissions.supergroup +hdfs +The name of the group of super-users. + + + +dfs.namenode.handler.count +100 +Added to grow Queue size so that more client connections are allowed + + + +ipc.server.max.response.size +5242880 + + +dfs.block.access.token.enable +true + If "true", access tokens are used as capabilities for accessing datanodes. If "false", no access tokens are checked on accessing datanodes. - - - - - dfs.namenode.kerberos.principal - nn/_HOST@ - + + + +dfs.namenode.kerberos.principal +nn/_HOST@ + Kerberos principal name for the NameNode - - - - - dfs.secondary.namenode.kerberos.principal - nn/_HOST@ + + + +dfs.secondary.namenode.kerberos.principal +nn/_HOST@ Kerberos principal name for the secondary NameNode. - - - dfs.namenode.kerberos.https.principal host/_HOST@ - The Kerberos principal for the host that the NameNode runs on. - - + The Kerberos principal for the host that the NameNode runs on. + + dfs.secondary.namenode.kerberos.https.principal host/_HOST@ The Kerberos principal for the hostthat the secondary NameNode runs on. - - + + dfs.secondary.http.address hdp2.cybervisiontech.com.ua:50090 Address of secondary namenode web server - - + dfs.secondary.https.port 50490 The https port where secondary-namenode binds - - + dfs.web.authentication.kerberos.principal HTTP/_HOST@ @@ -333,9 +306,8 @@ Kerberos principal name for the NameNode The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos HTTP SPENGO specification. - - + dfs.web.authentication.kerberos.keytab /nn.service.keytab @@ -343,91 +315,82 @@ Kerberos principal name for the NameNode The Kerberos keytab file with the credentials for the HTTP Kerberos principal used by Hadoop-Auth in the HTTP endpoint. - - + dfs.datanode.kerberos.principal dn/_HOST@ - + The Kerberos principal that the DataNode runs as. "_HOST" is replaced by the real host name. - - + dfs.namenode.keytab.file /nn.service.keytab - + Combined keytab file containing the namenode service and host principals. - - + dfs.secondary.namenode.keytab.file /nn.service.keytab - + Combined keytab file containing the namenode service and host principals. - - + dfs.datanode.keytab.file /dn.service.keytab - + The filename of the keytab file for the DataNode. - - + dfs.https.port 50470 - The https port where namenode binds - - + The https port where namenode binds + + dfs.https.address hdp1.cybervisiontech.com.ua:50470 - The https address where namenode binds - - + The https address where namenode binds + + dfs.datanode.data.dir.perm 750 - The permissions that should be there on dfs.data.dir +The permissions that should be there on dfs.data.dir directories. The datanode will not come up if the permissions are different on existing dfs.data.dir directories. If the directories don't exist, they will be created with this permission. - - + - dfs.access.time.precision - 0 - The access time for HDFS file is precise up to this value. + dfs.access.time.precision + 0 + The access time for HDFS file is precise up to this value. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. - - - - - dfs.cluster.administrators - hdfs - ACL for who all can view the default servlets in the HDFS - - - - - ipc.server.read.threadpool.size - 5 - - - - + + + + dfs.cluster.administrators + hdfs + ACL for who all can view the default servlets in the HDFS + + + + ipc.server.read.threadpool.size + 5 + + + http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml index 198fa94..db3a0ac 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.1/services/MAPREDUCE/configuration/mapred-site.xml @@ -1,5 +1,6 @@ + + + - + + + dfs.name.dir @@ -28,33 +33,29 @@ of directories then the name table is replicated in all of the directories, for redundancy. true - - + dfs.support.append true to enable dfs append true - - + dfs.webhdfs.enabled false to enable webhdfs true - - + dfs.datanode.failed.volumes.tolerated 0 #of failed disks dn would tolerate true - - + dfs.block.local-path-access.user hbase @@ -62,9 +63,8 @@ circuit reads. true - - + dfs.data.dir /mnt/hmc/hadoop/hdfs/data @@ -75,9 +75,8 @@ Directories that do not exist are ignored. true - - + dfs.hosts.exclude /etc/hadoop/conf/dfs.exclude @@ -85,9 +84,8 @@ not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded. - - + dfs.hosts /etc/hadoop/conf/dfs.include @@ -95,32 +93,28 @@ permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, all hosts are permitted. - - + dfs.replication.max 50 Maximal block replication. - - + dfs.replication 3 Default block replication. - - + dfs.heartbeat.interval 3 Determines datanode heartbeat interval in seconds. - - + dfs.safemode.threshold.pct 1.0f @@ -130,9 +124,8 @@ Values less than or equal to 0 mean not to start in safe mode. Values greater than 1 will make safe mode permanent. - - + dfs.balance.bandwidthPerSec 6250000 @@ -141,193 +134,174 @@ can utilize for the balancing purpose in term of the number of bytes per second. - - + dfs.datanode.address 0.0.0.0:50010 Address where the datanode binds - - + dfs.datanode.http.address 0.0.0.0:50075 HTTP address for the datanode - - + dfs.block.size 134217728 The default block size for new files. - - + dfs.http.address hdp1.cybervisiontech.com.ua:50070 - The name of the default file system. Either the +The name of the default file system. Either the literal string "local" or a host:port for HDFS. - true - - - - - dfs.datanode.du.reserved - - 1073741824 - Reserved space in bytes per volume. Always leave this much space free for non dfs use. +true + + + +dfs.datanode.du.reserved + +1073741824 +Reserved space in bytes per volume. Always leave this much space free for non dfs use. - - - - - dfs.datanode.ipc.address - 0.0.0.0:8010 - + + + +dfs.datanode.ipc.address +0.0.0.0:8010 + The datanode ipc server address and port. If the port is 0 then the server will start on a free port. - - - - - dfs.blockreport.initialDelay - 120 - Delay for first block report in seconds. - - - - - dfs.namenode.handler.count - 40 - The number of server threads for the namenode. - - - - - dfs.datanode.max.xcievers - 1024 - PRIVATE CONFIG VARIABLE - - - - - - dfs.umaskmode - 077 - + + + +dfs.blockreport.initialDelay +120 +Delay for first block report in seconds. + + + +dfs.namenode.handler.count +40 +The number of server threads for the namenode. + + + +dfs.datanode.max.xcievers +1024 +PRIVATE CONFIG VARIABLE + + + + + +dfs.umaskmode +077 + The octal umask used when creating files and directories. - - - - - dfs.web.ugi - - gopher,gopher - The user account used by the web interface. + + + +dfs.web.ugi + +gopher,gopher +The user account used by the web interface. Syntax: USERNAME,GROUP1,GROUP2, ... - - - - - dfs.permissions - true - + + + +dfs.permissions +true + If "true", enable permission checking in HDFS. If "false", permission checking is turned off, but all other behavior is unchanged. Switching from one parameter value to the other does not change the mode, owner or group of files or directories. - - - - - dfs.permissions.supergroup - hdfs - The name of the group of super-users. - - - - - dfs.namenode.handler.count - 100 - Added to grow Queue size so that more client connections are allowed - - - - - ipc.server.max.response.size - 5242880 - The max response size for IPC - - - - - dfs.block.access.token.enable - true - + + + +dfs.permissions.supergroup +hdfs +The name of the group of super-users. + + + +dfs.namenode.handler.count +100 +Added to grow Queue size so that more client connections are allowed + + + +ipc.server.max.response.size +5242880 +The max response size for IPC + + + +dfs.block.access.token.enable +true + If "true", access tokens are used as capabilities for accessing datanodes. If "false", no access tokens are checked on accessing datanodes. - - - - - dfs.namenode.kerberos.principal - nn/_HOST@ - + + + +dfs.namenode.kerberos.principal +nn/_HOST@ + Kerberos principal name for the NameNode - - - - - dfs.secondary.namenode.kerberos.principal - nn/_HOST@ + + + +dfs.secondary.namenode.kerberos.principal +nn/_HOST@ Kerberos principal name for the secondary NameNode. - - - dfs.namenode.kerberos.https.principal host/_HOST@ - The Kerberos principal for the host that the NameNode runs on. - - + The Kerberos principal for the host that the NameNode runs on. + + dfs.secondary.namenode.kerberos.https.principal host/_HOST@ The Kerberos principal for the hostthat the secondary NameNode runs on. - - + + dfs.secondary.http.address hdp2.cybervisiontech.com.ua:50090 Address of secondary namenode web server - - + dfs.secondary.https.port 50490 The https port where secondary-namenode binds - - + dfs.web.authentication.kerberos.principal HTTP/_HOST@ @@ -336,9 +310,8 @@ Kerberos principal name for the NameNode The HTTP Kerberos principal MUST start with 'HTTP/' per Kerberos HTTP SPENGO specification. - - + dfs.web.authentication.kerberos.keytab /nn.service.keytab @@ -346,91 +319,82 @@ Kerberos principal name for the NameNode The Kerberos keytab file with the credentials for the HTTP Kerberos principal used by Hadoop-Auth in the HTTP endpoint. - - + dfs.datanode.kerberos.principal dn/_HOST@ - + The Kerberos principal that the DataNode runs as. "_HOST" is replaced by the real host name. - - + dfs.namenode.keytab.file /nn.service.keytab - + Combined keytab file containing the namenode service and host principals. - - + dfs.secondary.namenode.keytab.file /nn.service.keytab - + Combined keytab file containing the namenode service and host principals. - - + dfs.datanode.keytab.file /dn.service.keytab - + The filename of the keytab file for the DataNode. - - + dfs.https.port 50470 - The https port where namenode binds - - + The https port where namenode binds + + dfs.https.address hdp1.cybervisiontech.com.ua:50470 - The https address where namenode binds - - + The https address where namenode binds + + dfs.datanode.data.dir.perm 750 - The permissions that should be there on dfs.data.dir +The permissions that should be there on dfs.data.dir directories. The datanode will not come up if the permissions are different on existing dfs.data.dir directories. If the directories don't exist, they will be created with this permission. - - + - dfs.access.time.precision - 0 - The access time for HDFS file is precise up to this value. + dfs.access.time.precision + 0 + The access time for HDFS file is precise up to this value. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. - - - - - dfs.cluster.administrators - hdfs - ACL for who all can view the default servlets in the HDFS - - - - - ipc.server.read.threadpool.size - 5 - IPC thread size - - - + + + + dfs.cluster.administrators + hdfs + ACL for who all can view the default servlets in the HDFS + + + + ipc.server.read.threadpool.size + 5 + IPC thread size + + http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml index ff77447..5024e85 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HBASE/configuration/hbase-site.xml @@ -29,16 +29,12 @@ in milliseconds. Default is 15. Set this value low if you want unit tests to be responsive. - - hbase.client.pause 5000 General client pause value. Used mostly as value to wait before running a retry of a failed get, region lookup, etc. - - hbase.master.meta.thread.rescanfrequency @@ -46,8 +42,6 @@ How long the HMaster sleeps (in milliseconds) between scans of the root and meta tables. - - hbase.server.thread.wakefrequency @@ -55,8 +49,6 @@ Time to sleep in between searches for work (in milliseconds). Used as sleep interval by service threads such as META scanner and log roller. - - hbase.regionserver.handler.count @@ -65,8 +57,6 @@ Same property is used by the HMaster for count of master handlers. Default is 10. - - hbase.master.lease.period @@ -76,8 +66,6 @@ value has been reduced so that the master will notice a dead region server sooner. The default is 30 seconds. - - hbase.master.info.port @@ -85,8 +73,6 @@ The port for the hbase master web UI Set to -1 if you do not want the info server to run. - - hbase.regionserver.info.port @@ -94,8 +80,6 @@ The port for the hbase regionserver web UI Set to -1 if you do not want the info server to run. - - hbase.regionserver.info.port.auto @@ -104,8 +88,6 @@ search if hbase.regionserver.info.port is already in use. Enabled for testing to run multiple tests on one machine. - - hbase.master.lease.thread.wakefrequency @@ -114,8 +96,6 @@ This value has been reduced due to the other reduced values above so that the master will notice a dead region server sooner. The default is 15 seconds. - - hbase.regionserver.optionalcacheflushinterval @@ -124,8 +104,6 @@ Amount of time to wait since the last time a region was flushed before invoking an optional cache flush. Default 60,000. - - hbase.regionserver.safemode @@ -134,8 +112,6 @@ Turn on/off safe mode in region server. Always on for production, always off for tests. - - hbase.hregion.max.filesize @@ -146,14 +122,10 @@ Keep the maximum filesize small so we split more often in tests. - - hadoop.log.dir ${user.dir}/../logs - - hbase.zookeeper.property.clientPort @@ -161,7 +133,5 @@ Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. - - http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml index 8e7db9a..12f539c 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/global.xml @@ -19,173 +19,127 @@ * limitations under the License. */ --> + namenode_host - + NameNode Host. - - dfs_name_dir /hadoop/hdfs/namenode NameNode Directories. - - snamenode_host - + Secondary NameNode. - - fs_checkpoint_dir /hadoop/hdfs/namesecondary Secondary NameNode checkpoint dir. - - datanode_hosts - + List of Datanode Hosts. - - dfs_data_dir /hadoop/hdfs/data Data directories for Data Nodes. - - hdfs_log_dir_prefix /var/log/hadoop Hadoop Log Dir Prefix - - hadoop_pid_dir_prefix /var/run/hadoop Hadoop PID Dir Prefix - - dfs_webhdfs_enabled true WebHDFS enabled - - hadoop_heapsize 1024 Hadoop maximum Java heap size - - namenode_heapsize 1024 NameNode Java heap size - - namenode_opt_newsize 200 Default size of Java new generation for NameNode (Java option -XX:NewSize) Note: The value of NameNode new generation size (default size of Java new generation for NameNode (Java option -XX:NewSize)) should be 1/8 of maximum heap size (-Xmx). Ensure that the value of the namenode_opt_newsize property is 1/8 the value of maximum heap size (-Xmx). - - namenode_opt_maxnewsize 640 NameNode maximum new generation size - - namenode_opt_permsize 128 NameNode permanent generation size - - namenode_opt_maxpermsize 256 NameNode maximum permanent generation size - - datanode_du_reserved 1 Reserved space for HDFS - - dtnode_heapsize 1024 DataNode maximum Java heap size - - dfs_datanode_failed_volume_tolerated 0 DataNode volumes failure toleration - - fs_checkpoint_period 21600 HDFS Maximum Checkpoint Delay - - fs_checkpoint_size 0.5 FS Checkpoint Size. - - security_enabled false Hadoop Security - - kerberos_domain EXAMPLE.COM Kerberos realm. - - kerberos_domain EXAMPLE.COM Kerberos realm. - - keytab_path /etc/security/keytabs KeyTab Directory. - - + http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml index 11e667f..21bf767 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hadoop-env.xml @@ -19,69 +19,52 @@ * limitations under the License. */ --> + hdfs_log_dir_prefix /var/log/hadoop Hadoop Log Dir Prefix - - hadoop_pid_dir_prefix /var/run/hadoop Hadoop PID Dir Prefix - - hadoop_heapsize 1024 Hadoop maximum Java heap size - - namenode_heapsize 1024 NameNode Java heap size - - namenode_opt_newsize 200 Default size of Java new generation for NameNode (Java option -XX:NewSize) Note: The value of NameNode new generation size (default size of Java new generation for NameNode (Java option -XX:NewSize)) should be 1/8 of maximum heap size (-Xmx). Ensure that the value of the namenode_opt_newsize property is 1/8 the value of maximum heap size (-Xmx). - - namenode_opt_maxnewsize 200 NameNode maximum new generation size - - namenode_opt_permsize 128 NameNode permanent generation size - - namenode_opt_maxpermsize 256 NameNode maximum permanent generation size - - dtnode_heapsize 1024 DataNode maximum Java heap size - - proxyuser_group @@ -91,54 +74,41 @@ false - - security_enabled false Hadoop Security - - kerberos_domain EXAMPLE.COM Kerberos realm. - - hdfs_user

HDFS User

hdfs User and Groups. - - ignore_groupsusers_create false Whether to ignores failures on users and group creation - - smokeuser

Smoke User

ambari-qa User executing service checks - - user_group

Hadoop Group

hadoop Proxy user group. - - + content @@ -232,12 +202,12 @@ export HADOOP_IDENT_STRING=$USER # Use libraries from standard classpath JAVA_JDBC_LIBS="" #Add libraries required by mysql connector -for jarFile in `ls /usr/share/java/*mysql* 2>/dev/null` +for jarFile in `ls /usr/share/java/*mysql* 2>/dev/null` do JAVA_JDBC_LIBS=${JAVA_JDBC_LIBS}:$jarFile done #Add libraries required by oracle connector -for jarFile in `ls /usr/share/java/*ojdbc* 2>/dev/null` +for jarFile in `ls /usr/share/java/*ojdbc* 2>/dev/null` do JAVA_JDBC_LIBS=${JAVA_JDBC_LIBS}:$jarFile done @@ -258,7 +228,6 @@ export JAVA_LIBRARY_PATH=${JAVA_LIBRARY_PATH}:/usr/lib/hadoop/lib/native/Linux-a content - - + http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml index ff77447..5024e85 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hbase-site.xml @@ -29,16 +29,12 @@ in milliseconds. Default is 15. Set this value low if you want unit tests to be responsive. - - hbase.client.pause 5000 General client pause value. Used mostly as value to wait before running a retry of a failed get, region lookup, etc. - - hbase.master.meta.thread.rescanfrequency @@ -46,8 +42,6 @@ How long the HMaster sleeps (in milliseconds) between scans of the root and meta tables. - - hbase.server.thread.wakefrequency @@ -55,8 +49,6 @@ Time to sleep in between searches for work (in milliseconds). Used as sleep interval by service threads such as META scanner and log roller. - - hbase.regionserver.handler.count @@ -65,8 +57,6 @@ Same property is used by the HMaster for count of master handlers. Default is 10. - - hbase.master.lease.period @@ -76,8 +66,6 @@ value has been reduced so that the master will notice a dead region server sooner. The default is 30 seconds. - - hbase.master.info.port @@ -85,8 +73,6 @@ The port for the hbase master web UI Set to -1 if you do not want the info server to run. - - hbase.regionserver.info.port @@ -94,8 +80,6 @@ The port for the hbase regionserver web UI Set to -1 if you do not want the info server to run. - - hbase.regionserver.info.port.auto @@ -104,8 +88,6 @@ search if hbase.regionserver.info.port is already in use. Enabled for testing to run multiple tests on one machine. - - hbase.master.lease.thread.wakefrequency @@ -114,8 +96,6 @@ This value has been reduced due to the other reduced values above so that the master will notice a dead region server sooner. The default is 15 seconds. - - hbase.regionserver.optionalcacheflushinterval @@ -124,8 +104,6 @@ Amount of time to wait since the last time a region was flushed before invoking an optional cache flush. Default 60,000. - - hbase.regionserver.safemode @@ -134,8 +112,6 @@ Turn on/off safe mode in region server. Always on for production, always off for tests. - - hbase.hregion.max.filesize @@ -146,14 +122,10 @@ Keep the maximum filesize small so we split more often in tests. - - hadoop.log.dir ${user.dir}/../logs - - hbase.zookeeper.property.clientPort @@ -161,7 +133,5 @@ Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. - - http://git-wip-us.apache.org/repos/asf/ambari/blob/0aeaa956/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml ---------------------------------------------------------------------- diff --git a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml index 685b702..ef81d5d 100644 --- a/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml +++ b/ambari-server/src/test/resources/stacks/HDP/0.2/services/HDFS/configuration/hdfs-log4j.xml @@ -19,7 +19,9 @@ * limitations under the License. */ --> + + content @@ -193,9 +195,8 @@ log4j.appender.EventCounter=org.apache.hadoop.log.metrics.EventCounter log4j.logger.org.apache.hadoop.conf.Configuration.deprecation=WARN - content + content - - +