ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Irina Easterling (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-12442) DataNodes and JournalNodes failed to start after enabling Kerberos via the Ambari Wizard.
Date Thu, 16 Jul 2015 21:25:04 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-12442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630363#comment-14630363
] 

Irina Easterling commented on AMBARI-12442:
-------------------------------------------

#JournalNode stdout:
{code}
2015-07-16 16:33:44,942 - Group['hadoop'] {'ignore_failures': False}
2015-07-16 16:33:44,943 - Group['users'] {'ignore_failures': False}
2015-07-16 16:33:44,944 - User['hive'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,945 - User['zookeeper'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,945 - User['oozie'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['users']}
2015-07-16 16:33:44,946 - User['ams'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,946 - User['falcon'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['users']}
2015-07-16 16:33:44,947 - User['tez'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['users']}
2015-07-16 16:33:44,947 - User['mahout'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,948 - User['ambari-qa'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['users']}
2015-07-16 16:33:44,948 - User['flume'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,949 - User['hdfs'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,949 - Modifying user hdfs
2015-07-16 16:33:44,971 - User['sqoop'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,972 - User['yarn'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,973 - User['mapred'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,973 - User['hbase'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,974 - User['hcat'] {'gid': 'hadoop', 'ignore_failures': False, 'groups':
['hadoop']}
2015-07-16 16:33:44,975 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-07-16 16:33:44,976 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']
{'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2015-07-16 16:33:44,983 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']
due to not_if
2015-07-16 16:33:44,983 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'recursive': True,
'mode': 0775, 'cd_access': 'a'}
2015-07-16 16:33:44,984 - File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-07-16 16:33:44,985 - Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase']
{'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2015-07-16 16:33:44,992 - Skipping Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2015-07-16 16:33:44,992 - Group['hdfs'] {'ignore_failures': False}
2015-07-16 16:33:44,993 - User['hdfs'] {'ignore_failures': False, 'groups': ['hadoop', 'hdfs',
'hdfs']}
2015-07-16 16:33:44,994 - Modifying user hdfs
2015-07-16 16:33:45,037 - Directory['/etc/hadoop'] {'mode': 0755}
2015-07-16 16:33:45,054 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content':
InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'}
2015-07-16 16:33:45,068 - Execute['('setenforce', '0')'] {'not_if': '(! which getenforce )
|| (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if':
'test -f /selinux/enforce'}
2015-07-16 16:33:45,073 - Skipping Execute['('setenforce', '0')'] due to not_if
2015-07-16 16:33:45,073 - Directory['/var/opt/teradata/log/hadoop'] {'owner': 'root', 'mode':
0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2015-07-16 16:33:45,075 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root',
'recursive': True, 'cd_access': 'a'}
2015-07-16 16:33:45,076 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'recursive': True,
'cd_access': 'a'}
2015-07-16 16:33:45,081 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties']
{'content': Template('commons-logging.properties.j2'), 'owner': 'root'}
2015-07-16 16:33:45,082 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content':
Template('health_check.j2'), 'owner': 'root'}
2015-07-16 16:33:45,083 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content':
'...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2015-07-16 16:33:45,093 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties']
{'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
2015-07-16 16:33:45,094 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties']
{'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2015-07-16 16:33:45,094 - File['/usr/hdp/current/hadoop-client/conf/configuration.xsl'] {'owner':
'hdfs', 'group': 'hadoop'}
2015-07-16 16:33:45,099 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs',
'content': Template('topology_mappings.data.j2'), 'group': 'hadoop'}
2015-07-16 16:33:45,100 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'),
'mode': 0755}
2015-07-16 16:33:45,247 - Directory['/var/opt/teradata/hadoop/hdfs/journal'] {'owner': 'hdfs',
'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2015-07-16 16:33:45,250 - Directory['/etc/security/limits.d'] {'owner': 'root', 'group': 'root',
'recursive': True}
2015-07-16 16:33:45,255 - File['/etc/security/limits.d/hdfs.conf'] {'content': Template('hdfs.conf.j2'),
'owner': 'root', 'group': 'root', 'mode': 0644}
2015-07-16 16:33:45,256 - XmlConfig['hadoop-policy.xml'] {'owner': 'hdfs', 'group': 'hadoop',
'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations':
...}
2015-07-16 16:33:45,266 - Generating config: /usr/hdp/current/hadoop-client/conf/hadoop-policy.xml
2015-07-16 16:33:45,267 - File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml'] {'owner':
'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2015-07-16 16:33:45,275 - Writing File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml']
because contents don't match
2015-07-16 16:33:45,276 - XmlConfig['ssl-client.xml'] {'owner': 'hdfs', 'group': 'hadoop',
'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations':
...}
2015-07-16 16:33:45,285 - Generating config: /usr/hdp/current/hadoop-client/conf/ssl-client.xml
2015-07-16 16:33:45,286 - File['/usr/hdp/current/hadoop-client/conf/ssl-client.xml'] {'owner':
'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2015-07-16 16:33:45,292 - Writing File['/usr/hdp/current/hadoop-client/conf/ssl-client.xml']
because contents don't match
2015-07-16 16:33:45,292 - Directory['/usr/hdp/current/hadoop-client/conf/secure'] {'owner':
'root', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2015-07-16 16:33:45,292 - XmlConfig['ssl-client.xml'] {'owner': 'hdfs', 'group': 'hadoop',
'conf_dir': '/usr/hdp/current/hadoop-client/conf/secure', 'configuration_attributes': {},
'configurations': ...}
2015-07-16 16:33:45,302 - Generating config: /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml
2015-07-16 16:33:45,302 - File['/usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml']
{'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding':
'UTF-8'}
2015-07-16 16:33:45,308 - Writing File['/usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml']
because contents don't match
2015-07-16 16:33:45,309 - XmlConfig['ssl-server.xml'] {'owner': 'hdfs', 'group': 'hadoop',
'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations':
...}
2015-07-16 16:33:45,318 - Generating config: /usr/hdp/current/hadoop-client/conf/ssl-server.xml
2015-07-16 16:33:45,318 - File['/usr/hdp/current/hadoop-client/conf/ssl-server.xml'] {'owner':
'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2015-07-16 16:33:45,325 - Writing File['/usr/hdp/current/hadoop-client/conf/ssl-server.xml']
because contents don't match
2015-07-16 16:33:45,325 - XmlConfig['hdfs-site.xml'] {'owner': 'hdfs', 'group': 'hadoop',
'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations':
...}
2015-07-16 16:33:45,335 - Generating config: /usr/hdp/current/hadoop-client/conf/hdfs-site.xml
2015-07-16 16:33:45,335 - File['/usr/hdp/current/hadoop-client/conf/hdfs-site.xml'] {'owner':
'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
2015-07-16 16:33:45,394 - Writing File['/usr/hdp/current/hadoop-client/conf/hdfs-site.xml']
because contents don't match
2015-07-16 16:33:45,394 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf',
'mode': 0644, 'configuration_attributes': {}, 'owner': 'hdfs', 'configurations': ...}
2015-07-16 16:33:45,404 - Generating config: /usr/hdp/current/hadoop-client/conf/core-site.xml
2015-07-16 16:33:45,404 - File['/usr/hdp/current/hadoop-client/conf/core-site.xml'] {'owner':
'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2015-07-16 16:33:45,433 - Writing File['/usr/hdp/current/hadoop-client/conf/core-site.xml']
because contents don't match
2015-07-16 16:33:45,435 - File['/usr/hdp/current/hadoop-client/conf/slaves'] {'content': Template('slaves.j2'),
'owner': 'root'}
2015-07-16 16:33:45,436 - Directory['/var/run/hadoop'] {'owner': 'hdfs', 'group': 'hadoop',
'mode': 0755}
2015-07-16 16:33:45,436 - Changing owner for /var/run/hadoop from 0 to hdfs
2015-07-16 16:33:45,436 - Changing group for /var/run/hadoop from 0 to hadoop
2015-07-16 16:33:45,436 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'recursive':
True}
2015-07-16 16:33:45,437 - Directory['/var/opt/teradata/log/hadoop/hdfs'] {'owner': 'hdfs',
'recursive': True}
2015-07-16 16:33:45,437 - File['/var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid'] {'action':
['delete'], 'not_if': 'ambari-sudo.sh  -H -E test -f /var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid
&& ambari-sudo.sh  -H -E pgrep -F /var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid'}
2015-07-16 16:33:45,448 - Deleting File['/var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid']
2015-07-16 16:33:45,449 - Execute['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'ulimit -c unlimited
;  /usr/hdp/current/hadoop-client/sbin/hadoop-daemon.sh --config /usr/hdp/current/hadoop-client/conf
start journalnode''] {'environment': {'HADOOP_LIBEXEC_DIR': '/usr/hdp/current/hadoop-client/libexec'},
'not_if': 'ambari-sudo.sh  -H -E test -f /var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid
&& ambari-sudo.sh  -H -E pgrep -F /var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid'}
{code}

>  DataNodes and JournalNodes failed to start  after enabling Kerberos via the Ambari Wizard.

> --------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-12442
>                 URL: https://issues.apache.org/jira/browse/AMBARI-12442
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-web
>    Affects Versions: 2.1.0
>         Environment: ambari-server-2.1.0-1462
>            Reporter: Irina Easterling
>            Priority: Blocker
>
> On an HDP-2.3 cluster the DataNodes and JournalNodes failed to start 
> after enabling Kerberos via the Ambari Wizard. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message