metron-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bernardo Rodrigues <bernardosgrodrig...@gmail.com>
Subject Re: [External] Re: Getting some fatals on ec2 deployment
Date Fri, 29 Apr 2016 06:50:19 GMT
Hi there,

I didn't get a lot of context from these emails but I'll try to help you.

If you are doing passwordless SSH into The nodes then you probably are
using certificates to suthenticate the login. Are you sure the nodes have
enough information to allow ssh'ing from each other?

Regards,
Bernardo
Em 29/04/2016 01:53, "Lin, Jimmy [USA]" <lin_jimmy@bah.com> escreveu:

>
>
>
>
>
> On 4/28/16, 3:15 PM, "Nick Allen" <nick@nickallen.org> wrote:
>
> >After deployment fails, you have some hosts that Ansible is able to
> >connect to and others that Ansible cannot.  Yet at the same time you
> >are able to manually SSH to all the hosts.  What happens when at this
> >point you re-run the deployment script?  Can Ansible talk to all the
> >hosts or only the hosts that it could before?
>
> It fails to connect on the same nodes (or it doesn’t check again).  I’m
> retrying with the exact same command each time.
> >
> >When you manually SSH to the hosts manually do you type exactly this;
> >ssh centos@<hostname>?  Does it log you on without prompting for a
> >password?
> >
> Yeah.  I can passwordless ssh from my mac to each of the nodes.  Even
> those that fail with the “unreachable” error.
> >
> >
> >On Thu, Apr 28, 2016 at 8:42 AM, Lin, Jimmy [USA] <lin_jimmy@bah.com>
> wrote:
> >> This AM I tried the deployment against a different AWS account just to
> make sure there wasn’t any weird limits in AWS that were being applied.  I
> also ssh’ed into nodes that claim success and failure for that setup step
> below and confirmed that the metron key pair is in ~/.ssh/authorized_keys.
> On the nodes where setup was successful, there was a .ansible directory in
> ~.  The nodes that failed did not have the .ansible directory.  I could try
> running this against a different region as I am on the east coast.  Could
> that help?
> >>
> >>
> >>
> >>
> >>
> >> On 4/27/16, 10:37 PM, "Lin, Jimmy [USA]" <lin_jimmy@bah.com> wrote:
> >>
> >>>Nick,
> >>>
> >>>Out of the 10 nodes that the playbook deploys, it seems that the step
> after the first “Wait for connectivity check” fails for 6 out of the 10.
> Thus the included nodes for follow on steps only has 4 hosts.  Do you know
> why some of the nodes would fail this step?  Here is the relevant output
> section.  The number of nodes that succeeds varies each time I rerun the
> playbook.  In previous runs it was 2 nodes that succeeded.  Here is the
> relevant portions of the output:
> >>>
> >>>
> >>>
> >>>TASK [include]
> *****************************************************************
> >>>included:
> /Users/jimmylin/projects/incubator-metron/deployment/amazon-ec2/tasks/check-hosts.yml
> for ec2-54-186-23-44.us-west-2.compute.amazonaws.com,
> ec2-54-186-20-174.us-west-2.compute.amazonaws.com,
> ec2-54-191-214-175.us-west-2.compute.amazonaws.com,
> ec2-54-187-79-63.us-west-2.compute.amazonaws.com,
> ec2-54-200-229-166.us-west-2.compute.amazonaws.com,
> ec2-54-186-13-200.us-west-2.compute.amazonaws.com,
> ec2-54-187-78-58.us-west-2.compute.amazonaws.com,
> ec2-54-187-21-220.us-west-2.compute.amazonaws.com,
> ec2-54-187-99-63.us-west-2.compute.amazonaws.com,
> ec2-54-191-238-214.us-west-2.compute.amazonaws.com
> >>>
> >>>
> >>>TASK [Wait for connectivity to host(s)]
> ****************************************
> >>>ok: [ec2-54-186-20-174.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-186-23-44.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-191-214-175.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-186-13-200.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-187-78-58.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-187-21-220.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-187-79-63.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-200-229-166.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-187-99-63.us-west-2.compute.amazonaws.com -> localhost]
> >>>ok: [ec2-54-191-238-214.us-west-2.compute.amazonaws.com -> localhost]
> >>>
> >>>
> >>>PLAY [ec2]
> *********************************************************************
> >>>
> >>>
> >>>TASK [setup]
> *******************************************************************
> >>>fatal: [ec2-54-186-20-174.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>fatal: [ec2-54-191-214-175.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>fatal: [ec2-54-186-13-200.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>fatal: [ec2-54-200-229-166.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>fatal: [ec2-54-187-21-220.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>fatal: [ec2-54-191-238-214.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>ok: [ec2-54-186-23-44.us-west-2.compute.amazonaws.com]
> >>>ok: [ec2-54-187-79-63.us-west-2.compute.amazonaws.com]
> >>>ok: [ec2-54-187-78-58.us-west-2.compute.amazonaws.com]
> >>>ok: [ec2-54-187-99-63.us-west-2.compute.amazonaws.com]
> >>>
> >>>
> >>>TASK [include]
> *****************************************************************
> >>>included:
> /Users/jimmylin/projects/incubator-metron/deployment/amazon-ec2/tasks/mount-volume.yml
> for ec2-54-186-23-44.us-west-2.compute.amazonaws.com,
> ec2-54-187-79-63.us-west-2.compute.amazonaws.com,
> ec2-54-187-78-58.us-west-2.compute.amazonaws.com,
> ec2-54-187-99-63.us-west-2.compute.amazonaws.com
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>On 4/27/16, 9:51 PM, "Nick Allen" <nick@nickallen.org> wrote:
> >>>
> >>>>The 'ec2.py' references the dynamic host inventory script that is used
> >>>>by Ansible to discover the hosts that need provisioned.  It is
> >>>>embedded in the Ansible distribution.
> >>>>
> >>>>It is odd that you had 2 nodes work fine, but the remainder failed.  I
> >>>>am wondering if that is because some of the nodes were created on
> >>>>previous runs with a different SSH key. Between runs of trying to get
> >>>>this to work, be sure to terminate all of the EC2 nodes that get
> >>>>created.  Start fresh each time, just to be sure, until you get this
> >>>>working.
> >>>>
> >>>>Also be sure that you are setting the EC2_INI_PATH environment
> >>>>variable before running the playbook.
> >>>>
> >>>>   export EC2_INI_PATH=conf/ec2.ini
> >>>>   ansible-playbook -i ec2.py playbook.yml
> >>>>
> >>>>I would suggest working with 'master' instead of RC7.  Try getting the
> >>>>basics to work first.  Do not set a custom SSH key.  Terminate all
> >>>>existing EC2 nodes and then start a fresh run.  Also, remove your
> >>>>ansible.log so that you can capture just what happens on the latest
> >>>>run.  Let us know what happens.
> >>>>
> >>>>
> >>>>
> >>>>On Wed, Apr 27, 2016 at 4:13 PM, Lin, Jimmy [USA] <lin_jimmy@bah.com>
> wrote:
> >>>>> I run through all of the steps and when I run:
> >>>>>
> >>>>> ansible-playbook -i ec2.py playbook.yml
> >>>>>
> >>>>>
> >>>>> I get some fatal errors, but the script does not stop.  What is
> ec2.py?  That file doesn’t seem to exist anywhere.  Also, to be clear, I am
> running that line from the deployment/amazon-ec2 folder.
> >>>>>
> >>>>> Here is the output from the last time I ran it:
> >>>>>
> >>>>> ansible-playbook -i ec2.py playbook.yml
> >>>>>  [WARNING]: Host file not found: ec2.py
> >>>>>
> >>>>>
> >>>>>  [WARNING]: provided hosts list is empty, only localhost is available
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> PLAY [localhost]
> ***************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-keypair.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [set_fact]
> ****************************************************************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Define keypair]
> **********************************************************
> >>>>> ok: [localhost] => (item=ssh-rsa
> AAAAB3NzaC1yc2EAAAADAQABAAABAQDMjGoukP8l+Qesk4PqBjug+OGgQ51knRGc2woivMXVtWk6DDvEQ+K23Wq7Q8ea5kz4gZEvhhE+RlIA9R6H6PXeUhMuR+xaijly35Scz5oDqDkniwPxRefyP2t6bC4JZ3ceRaeAnH9K69ef+PAfCe3h+N26QlSGNbaha0E1SNAVWYFUS3QJYlUKan80vglwnQXtglyvMv8WgoH5HGFShwExW8qaoVoDyd3MNGLbIN9jvueHI+XG/rvqTSy3rl2Y8o+SZ2MauqqLEcKvTmj3zFvcG+XXH7jH8wbimEPhR1lOrsRIh/n0TdGYjbjfsLFpte94ePpj+ghL8FQdf0bAY/QF
> jimmylin@C02NK1ZQG3QP.local)
> >>>>>
> >>>>>
> >>>>> TASK [debug]
> *******************************************************************
> >>>>> ok: [localhost] => {
> >>>>>     "msg": "Created keypair 'metron-test-metron-key' from
> '~/.ssh/id_rsa.pub'"
> >>>>> }
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-vpc.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test:  Create virtual private cloud]
> ******************************
> >>>>> changed: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [[metron-test] Created vpc with id=vpc-61dc7c05]
> **************************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-open-inbound-security-group.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Define open inbound security group]
> *************************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-open-outbound-security-group.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Define open outbound security group]
> ************************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-hosts.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Instantiate 1 host(s) as
> sensors,ambari_master,metron,ec2] **
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Add host(s) to a hostgroup]
> **********************************************
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-100.us-west-2.compute.internal',
> u'public_ip': u'54.200.158.35', u'private_ip': u'10.0.0.100', u'id':
> u'i-02a74ddf', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-205f0f99'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-ff5f0f46'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-555e0eec'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-200-158-35.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'sensors,ambari_master,metron,ec2', u'Name':
> u'[metron-test] sensors,ambari_master,metron,ec2', u'env': u'metron-test'},
> u'placement': u'us-west-2c', u'ami_launch_index': u'0', u'dns_name': u'
> ec2-54-200-158-35.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:23:42.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-hosts.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Instantiate 4 host(s) as ambari_slave,ec2]
> ******************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Add host(s) to a hostgroup]
> **********************************************
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-249.us-west-2.compute.internal',
> u'public_ip': u'54.186.225.238', u'private_ip': u'10.0.0.249', u'id':
> u'i-a8a54f75', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-9d401024'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-445f0ffd'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-635f0fda'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-186-225-238.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test]
> ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2c',
> u'ami_launch_index': u'2', u'dns_name': u'
> ec2-54-186-225-238.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:24:11.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-250.us-west-2.compute.internal',
> u'public_ip': u'54.200.145.97', u'private_ip': u'10.0.0.250', u'id':
> u'i-aba54f76', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-a9401010'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-8e401037'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-fe401047'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-200-145-97.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test]
> ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2c',
> u'ami_launch_index': u'1', u'dns_name': u'
> ec2-54-200-145-97.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:24:11.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-251.us-west-2.compute.internal',
> u'public_ip': u'54.187.25.6', u'private_ip': u'10.0.0.251', u'id':
> u'i-aaa54f77', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-81401038'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-80401039'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-625f0fdb'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-187-25-6.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test]
> ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2c',
> u'ami_launch_index': u'0', u'dns_name': u'
> ec2-54-187-25-6.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:24:11.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-248.us-west-2.compute.internal',
> u'public_ip': u'54.191.198.134', u'private_ip': u'10.0.0.248', u'id':
> u'i-52a54f8f', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-ff401046'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-8340103a'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-475f0ffe'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-191-198-134.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'ambari_slave,ec2', u'Name': u'[metron-test]
> ambari_slave,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2c',
> u'ami_launch_index': u'3', u'dns_name': u'
> ec2-54-191-198-134.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:24:11.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-hosts.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Instantiate 1 host(s) as
> ambari_slave,hadoop_client,metron,ec2] ***
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Add host(s) to a hostgroup]
> **********************************************
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-35.us-west-2.compute.internal',
> u'public_ip': u'54.187.172.159', u'private_ip': u'10.0.0.35', u'id':
> u'i-32a44eef', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-cb401072'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-3240108b'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-7f4010c6'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-187-172-159.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'ambari_slave,hadoop_client,metron,ec2', u'Name':
> u'[metron-test] ambari_slave,hadoop_client,metron,ec2', u'env':
> u'metron-test'}, u'placement': u'us-west-2c', u'ami_launch_index': u'0',
> u'dns_name': u'ec2-54-187-172-159.us-west-2.compute.amazonaws.com',
> u'region': u'us-west-2', u'launch_time': u'2016-04-27T19:24:43.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-hosts.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Instantiate 1 host(s) as
> ambari_slave,enrichment,metron,ec2]
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Add host(s) to a hostgroup]
> **********************************************
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-78.us-west-2.compute.internal',
> u'public_ip': u'54.186.227.146', u'private_ip': u'10.0.0.78', u'id':
> u'i-54ba5089', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-184010a1'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-1a4010a3'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-5e4010e7'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-186-227-146.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'ambari_slave,enrichment,metron,ec2', u'Name':
> u'[metron-test] ambari_slave,enrichment,metron,ec2', u'env':
> u'metron-test'}, u'placement': u'us-west-2c', u'ami_launch_index': u'0',
> u'dns_name': u'ec2-54-186-227-146.us-west-2.compute.amazonaws.com',
> u'region': u'us-west-2', u'launch_time': u'2016-04-27T19:25:12.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-hosts.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Instantiate 2 host(s) as search,metron,ec2]
> *****************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Add host(s) to a hostgroup]
> **********************************************
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-58.us-west-2.compute.internal',
> u'public_ip': u'54.186.101.72', u'private_ip': u'10.0.0.58', u'id':
> u'i-58ba5085', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-8a411133'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-df401066'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-9f411126'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-186-101-72.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'search,metron,ec2', u'Name': u'[metron-test]
> search,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2c',
> u'ami_launch_index': u'1', u'dns_name': u'
> ec2-54-186-101-72.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:25:37.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-59.us-west-2.compute.internal',
> u'public_ip': u'54.186.18.33', u'private_ip': u'10.0.0.59', u'id':
> u'i-5bba5086', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-9e411127'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-0a4010b3'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-b8411101'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'search,metron,ec2', u'Name': u'[metron-test]
> search,metron,ec2', u'env': u'metron-test'}, u'placement': u'us-west-2c',
> u'ami_launch_index': u'0', u'dns_name': u'
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:25:37.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/create-hosts.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [metron-test: Instantiate 1 host(s) as web,mysql,metron,ec2]
> **************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [Add host(s) to a hostgroup]
> **********************************************
> >>>>> changed: [localhost] => (item={u'kernel': None, u'root_device_type':
> u'ebs', u'private_dns_name': u'ip-10-0-0-173.us-west-2.compute.internal',
> u'public_ip': u'54.187.163.186', u'private_ip': u'10.0.0.173', u'id':
> u'i-06ba50db', u'ebs_optimized': False, u'state': u'running',
> u'virtualization_type': u'hvm', u'architecture': u'x86_64', u'ramdisk':
> None, u'block_device_mapping': {u'/dev/xvdb': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-9541112c'},
> u'/dev/xvdc': {u'status': u'attached', u'delete_on_termination': True,
> u'volume_id': u'vol-d441116d'}, u'/dev/sda1': {u'status': u'attached',
> u'delete_on_termination': True, u'volume_id': u'vol-bc411105'}},
> u'key_name': u'metron-test-metron-key', u'image_id': u'ami-05cf2265',
> u'tenancy': u'default', u'groups': {u'sg-932212f4':
> u'metron-test-vpc-all-outbound', u'sg-892212ee':
> u'metron-test-vpc-all-inbound'}, u'public_dns_name': u'
> ec2-54-187-163-186.us-west-2.compute.amazonaws.com', u'state_code': 16,
> u'tags': {u'type': u'web,mysql,metron,ec2', u'Name': u'[metron-test]
> web,mysql,metron,ec2', u'env': u'metron-test'}, u'placement':
> u'us-west-2c', u'ami_launch_index': u'0', u'dns_name': u'
> ec2-54-187-163-186.us-west-2.compute.amazonaws.com', u'region':
> u'us-west-2', u'launch_time': u'2016-04-27T19:26:04.000Z',
> u'instance_type': u'm4.xlarge', u'root_device_name': u'/dev/sda1',
> u'hypervisor': u'xen'})
> >>>>>
> >>>>>
> >>>>> PLAY [ec2]
> *********************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/check-hosts.yml
> for ec2-54-200-158-35.us-west-2.compute.amazonaws.com,
> ec2-54-186-225-238.us-west-2.compute.amazonaws.com,
> ec2-54-200-145-97.us-west-2.compute.amazonaws.com,
> ec2-54-187-25-6.us-west-2.compute.amazonaws.com,
> ec2-54-191-198-134.us-west-2.compute.amazonaws.com,
> ec2-54-187-172-159.us-west-2.compute.amazonaws.com,
> ec2-54-186-227-146.us-west-2.compute.amazonaws.com,
> ec2-54-186-101-72.us-west-2.compute.amazonaws.com,
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com,
> ec2-54-187-163-186.us-west-2.compute.amazonaws.com
> >>>>>
> >>>>>
> >>>>> TASK [Wait for connectivity to host(s)]
> ****************************************
> >>>>> ok: [ec2-54-186-225-238.us-west-2.compute.amazonaws.com ->
> localhost]
> >>>>> ok: [ec2-54-200-158-35.us-west-2.compute.amazonaws.com -> localhost]
> >>>>> ok: [ec2-54-200-145-97.us-west-2.compute.amazonaws.com -> localhost]
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com -> localhost]
> >>>>> ok: [ec2-54-186-227-146.us-west-2.compute.amazonaws.com ->
> localhost]
> >>>>> ok: [ec2-54-187-172-159.us-west-2.compute.amazonaws.com ->
> localhost]
> >>>>> ok: [ec2-54-191-198-134.us-west-2.compute.amazonaws.com ->
> localhost]
> >>>>> ok: [ec2-54-186-101-72.us-west-2.compute.amazonaws.com -> localhost]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com -> localhost]
> >>>>> ok: [ec2-54-187-163-186.us-west-2.compute.amazonaws.com ->
> localhost]
> >>>>>
> >>>>>
> >>>>> PLAY [ec2]
> *********************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> fatal: [ec2-54-200-158-35.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-186-101-72.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-186-227-146.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-191-198-134.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-187-163-186.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-186-225-238.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-200-145-97.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> fatal: [ec2-54-187-172-159.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/mount-volume.yml
> for ec2-54-187-25-6.us-west-2.compute.amazonaws.com,
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com
> >>>>>
> >>>>>
> >>>>> TASK [Install xfsprogs]
> ********************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [Format data volume(s)]
> ***************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [Mount the volume]
> ********************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/mount-volume.yml
> for ec2-54-187-25-6.us-west-2.compute.amazonaws.com,
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com
> >>>>>
> >>>>>
> >>>>> TASK [Install xfsprogs]
> ********************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [Format data volume(s)]
> ***************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [Mount the volume]
> ********************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/check-volume.yml
> for ec2-54-187-25-6.us-west-2.compute.amazonaws.com,
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com
> >>>>>
> >>>>>
> >>>>> TASK [Check size of volume /dev/xvda]
> ******************************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>> changed: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [Status of /dev/xvda volume]
> **********************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com] => {
> >>>>>     "msg": "volume=/dev/xvda current=50 expected=50"
> >>>>> }
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] => {
> >>>>>     "msg": "volume=/dev/xvda current=50 expected=50"
> >>>>> }
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> skipping: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> skipping: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> PLAY [ec2]
> *********************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [include_vars]
> ************************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> PLAY [ambari_*]
> ****************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [libselinux-python : Install libselinux-python]
> ***************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [yum-update : Yum Update Packages]
> ****************************************
> >>>>> changed: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [epel : Get epel-repo rpm]
> ************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [epel : Install epel-repo rpm]
> ********************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ntp : Install ntp]
> *******************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ntp : Ensure ntp is running and enabled]
> *********************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ambari_common : Check OS Version]
> ****************************************
> >>>>> skipping: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ambari_common : include]
> *************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/ambari_common/tasks/passwd_less_ssh.yml
> for ec2-54-187-25-6.us-west-2.compute.amazonaws.com
> >>>>>
> >>>>>
> >>>>> TASK [ambari_common : Generate ssh key pair for "admin"]
> ***********************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ambari_common : Fetch the generated public key]
> **************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ambari_common : Add key pairs to existing authorized_keys]
> ***************
> >>>>> fatal: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]: FAILED!
> => {"failed": true, "msg": "the file_name
> '/tmp/keys/ec2-54-200-158-35.us-west-2.compute.amazonaws.com.pub' does not
> exist, or is not readable"}
> >>>>>
> >>>>>
> >>>>> PLAY [ambari_master]
> ***********************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [ambari_slave]
> ************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ambari_slave : Install ambari-agent]
> *************************************
> >>>>> fatal: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]: FAILED!
> => {"changed": false, "failed": true, "msg": "No Package matching
> 'ambari-agent' found available, installed or updated", "rc": 0, "results":
> []}
> >>>>>
> >>>>>
> >>>>> NO MORE HOSTS LEFT
> *************************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [ambari_master]
> ***********************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [ec2]
> *********************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [include_vars]
> ************************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> PLAY [metron]
> ******************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [yum-update : Yum Update Packages]
> ****************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [epel : Get epel-repo rpm]
> ************************************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [epel : Install epel-repo rpm]
> ********************************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ntp : Install ntp]
> *******************************************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [ntp : Ensure ntp is running and enabled]
> *********************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [metron_common : Check OS Version]
> ****************************************
> >>>>> skipping: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [metron_common : Check for Metron jar path]
> *******************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [metron_common : Verify Metron jars exist]
> ********************************
> >>>>> skipping: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [metron_common : Ensure iptables is stopped and is not running
> at boot time.] ***
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> PLAY [hadoop_client]
> ***********************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [search]
> ******************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"]
> *******************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [java_jdk : Alternatives link for java]
> ***********************************
> >>>>> skipping: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link':
> u'/usr/bin/java', u'name': u'java'})
> >>>>> skipping: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link':
> u'/usr/bin/jar', u'name': u'jar'})
> >>>>>
> >>>>>
> >>>>> TASK [java_jdk : Install openjdk]
> **********************************************
> >>>>> skipping: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item=[u'java-1.8.0-openjdk', u'java-1.8.0-openjdk-devel'])
> >>>>>
> >>>>>
> >>>>> TASK [epel : Get epel-repo rpm]
> ************************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [epel : Install epel-repo rpm]
> ********************************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [python-pip : Install python-pip]
> *****************************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [httplib2 : Install python httplib2 dependency]
> ***************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [libselinux-python : Install libselinux-python]
> ***************************
> >>>>> ok: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Add Elasticsearch GPG key.]
> ******************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Add Elasticsearch repository.]
> ***************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Install Elasticsearch.]
> **********************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Create Data Directories]
> *********************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item=/data1/elasticsearch)
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item=/data2/elasticsearch)
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Configure Elasticsearch.]
> ********************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item={u'regexp': u'#cluster\\.name', u'line': u'cluster.name: metron'})
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item={u'regexp': u'#network\\.host:', u'line': u'network.host:
> _eth0:ipv4_'})
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item={u'regexp': u'#discovery\\.zen\\.ping\\.unicast\\.hosts', u'line':
> u'discovery.zen.ping.unicast.hosts: [
> ec2-54-186-101-72.us-west-2.compute.amazonaws.com,
> ec2-54-186-18-33.us-west-2.compute.amazonaws.com ]'})
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com] =>
> (item={u'regexp': u'#path\\.data', u'line': u'path.data:
> /data1/elasticsearch,/data2/elasticsearch'})
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Start Elasticsearch.]
> ************************************
> >>>>> changed: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : include]
> *************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/roles/elasticsearch/tasks/configure_index.yml
> for ec2-54-186-18-33.us-west-2.compute.amazonaws.com
> >>>>>
> >>>>>
> >>>>> TASK [elasticsearch : Wait for Elasticsearch Host to Start]
> ********************
> >>>>> fatal: [ec2-54-186-18-33.us-west-2.compute.amazonaws.com]: FAILED!
> => {"changed": false, "elapsed": 300, "failed": true, "msg": "Timeout when
> waiting for ec2-54-186-101-72.us-west-2.compute.amazonaws.com:9200"}
> >>>>>
> >>>>>
> >>>>> PLAY [mysql]
> *******************************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [ambari_slave]
> ************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [mysql_client : Get Default mysql passowrd]
> *******************************
> >>>>> ok: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]
> >>>>>
> >>>>>
> >>>>> TASK [mysql_client : Allow remote login to mysql]
> ******************************
> >>>>> fatal: [ec2-54-187-25-6.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host
> via ssh.", "unreachable": true}
> >>>>>
> >>>>>
> >>>>> PLAY [sensors]
> *****************************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [enrichment]
> **************************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [web]
> *********************************************************************
> >>>>>
> >>>>>
> >>>>> PLAY [localhost]
> ***************************************************************
> >>>>>
> >>>>>
> >>>>> TASK [setup]
> *******************************************************************
> >>>>> ok: [localhost]
> >>>>>
> >>>>>
> >>>>> TASK [include]
> *****************************************************************
> >>>>> included:
> /Users/jimmylin/projects/metron/incubator-metron-Metron_0.1BETA_rc7/deployment/amazon-ec2/tasks/provisioning-report.yml
> for localhost
> >>>>>
> >>>>>
> >>>>> TASK [Known hosts groups]
> ******************************************************
> >>>>> ok: [localhost] => {
> >>>>>     "groups": {
> >>>>>         "all": [
> >>>>>             "localhost",
> >>>>>             "ec2-54-200-158-35.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-225-238.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-200-145-97.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-25-6.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-191-198-134.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-172-159.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-227-146.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-101-72.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-18-33.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-163-186.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "ambari_master": [
> >>>>>             "ec2-54-200-158-35.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "ambari_slave": [
> >>>>>             "ec2-54-186-225-238.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-200-145-97.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-25-6.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-191-198-134.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-172-159.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-227-146.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "ec2": [
> >>>>>             "ec2-54-200-158-35.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-225-238.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-200-145-97.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-25-6.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-191-198-134.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-172-159.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-227-146.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-101-72.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-18-33.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-163-186.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "enrichment": [
> >>>>>             "ec2-54-186-227-146.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "hadoop_client": [
> >>>>>             "ec2-54-187-172-159.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "metron": [
> >>>>>             "ec2-54-200-158-35.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-172-159.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-227-146.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-101-72.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-18-33.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-187-163-186.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "mysql": [
> >>>>>             "ec2-54-187-163-186.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "search": [
> >>>>>             "ec2-54-186-101-72.us-west-2.compute.amazonaws.com",
> >>>>>             "ec2-54-186-18-33.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "sensors": [
> >>>>>             "ec2-54-200-158-35.us-west-2.compute.amazonaws.com"
> >>>>>         ],
> >>>>>         "ungrouped": [
> >>>>>             "localhost"
> >>>>>         ],
> >>>>>         "web": [
> >>>>>             "ec2-54-187-163-186.us-west-2.compute.amazonaws.com"
> >>>>>         ]
> >>>>>     }
> >>>>> }
> >>>>>
> >>>>>
> >>>>> TASK [Sanity check Metron web]
> *************************************************
> >>>>> fatal: [localhost -> localhost]: FAILED! => {"changed": false,
> "elapsed": 20, "failed": true, "msg": "Timeout when waiting for
> ec2-54-187-163-186.us-west-2.compute.amazonaws.com:5000"}
> >>>>>         to retry, use: --limit @playbook.retry
> >>>>>
> >>>>>
> >>>>> PLAY RECAP
> *********************************************************************
> >>>>> ec2-54-186-101-72.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-186-18-33.us-west-2.compute.amazonaws.com : ok=41
>  changed=15   unreachable=0    failed=1
> >>>>> ec2-54-186-225-238.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-186-227-146.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-187-163-186.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-187-172-159.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-187-25-6.us-west-2.compute.amazonaws.com : ok=31
>  changed=2    unreachable=1    failed=2
> >>>>> ec2-54-191-198-134.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-200-145-97.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> ec2-54-200-158-35.us-west-2.compute.amazonaws.com : ok=2
> changed=0    unreachable=1    failed=0
> >>>>> localhost                  : ok=33   changed=7    unreachable=0
> failed=1
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> On 4/27/16, 4:06 PM, "Nick Allen" <nick@nickallen.org> wrote:
> >>>>>
> >>>>>>And yes a project reorganization was merged in today.  As part of
> >>>>>>that, metron-streaming became metron-platform.  The README was
> updated
> >>>>>>to match the changes.  If we missed something, please let us know.
> >>>>>>
> >>>>>>On Wed, Apr 27, 2016 at 4:03 PM, Nick Allen <nick@nickallen.org>
> wrote:
> >>>>>>> I am sorry, but I don't understand how you are seeing multiple
> fatal
> >>>>>>> errors.  If you get one fatal error, the deployment process should
> >>>>>>> fail and terminate right there.  Is that not what is happening?
> >>>>>>>
> >>>>>>> Can you provide the commands that you've run at the terminal along
> >>>>>>> with the output?  It would help to see the commands and output
> leading
> >>>>>>> up to the error and not just the error messages themselves.
> >>>>>>>
> >>>>>>> Thanks
> >>>>>>>
> >>>>>>>
> >>>>>>> On Wed, Apr 27, 2016 at 3:01 PM, Lin, Jimmy [USA] <
> lin_jimmy@bah.com> wrote:
> >>>>>>>> Nick,
> >>>>>>>>
> >>>>>>>> I ran through the steps in the guide in the amazon ec2 deployment
> README.
> >>>>>>>> The steps seem to be very similar to the ones you provided.  I
> did attempt
> >>>>>>>> to run it once without my id_rsa.pub generated.  Then I went back
> and
> >>>>>>>> generated that file and reran the install.  I am not trying to
> use a custom
> >>>>>>>> ssh key.  Also, it looks like the source code changed today?
> There is no
> >>>>>>>> longer a metron-streaming folder.  I’m assuming that
> metro-platform is the
> >>>>>>>> new metron-streaming.  Will building this work?
> >>>>>>>>
> >>>>>>>> Here are the versions:
> >>>>>>>>
> >>>>>>>> ansible 2.0.2.0
> >>>>>>>>
> >>>>>>>>   config file =
> >>>>>>>>
> >>>>>>>>   configured module search path = Default w/o overrides
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> Vagrant 1.7.4
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> From: Nick Allen <nick@nickallen.org>
> >>>>>>>> Reply-To: "user@metron.incubator.apache.org"
> >>>>>>>> <user@metron.incubator.apache.org>
> >>>>>>>> Date: Wednesday, April 27, 2016 at 11:17 AM
> >>>>>>>> To: "user@metron.incubator.apache.org" <
> user@metron.incubator.apache.org>
> >>>>>>>> Subject: [External] Re: Getting some fatals on ec2 deployment
> >>>>>>>>
> >>>>>>>> Here is some additional documentation that may help;
> >>>>>>>> https://github.com/nickwallen/metron-first-steps-in-the-cloud.
> And, of
> >>>>>>>> course, let me pester you with additional questions.
> >>>>>>>>
> >>>>>>>> Can you describe in greater detail what exact files you edited
> and what
> >>>>>>>> commands you have run?
> >>>>>>>>
> >>>>>>>> What version of Ansible and Vagrant are you running?
> >>>>>>>>
> >>>>>>>> Are you trying to use a custom SSH key?
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Wed, Apr 27, 2016 at 10:26 AM, Lin, Jimmy [USA] <
> lin_jimmy@bah.com>
> >>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>> I’ve tried to deploy Metron to ec2 using the guide found here:
> >>>>>>>>>
> https://github.com/apache/incubator-metron/tree/master/metron-deployment/amazon-ec2
> .
> >>>>>>>>>
> >>>>>>>>> I get numerous fatal errors such as:
> >>>>>>>>>
> >>>>>>>>> TASK [setup]
> >>>>>>>>>
> *******************************************************************
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-149-.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! =>
> >>>>>>>>> {"changed": false, "msg": "Failed to connect to the host via
> ssh.",
> >>>>>>>>> "unreachable": true}
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-191-.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! =>
> >>>>>>>>> {"changed": false, "msg": "Failed to connect to the host via
> ssh.",
> >>>>>>>>> "unreachable": true}
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-191-.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! =>
> >>>>>>>>> {"changed": false, "msg": "Failed to connect to the host via
> ssh.",
> >>>>>>>>> "unreachable": true}
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-186-.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! =>
> >>>>>>>>> {"changed": false, "msg": "Failed to connect to the host via
> ssh.",
> >>>>>>>>> "unreachable": true}
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-149-.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! =>
> >>>>>>>>> {"changed": false, "msg": "Failed to connect to the host via
> ssh.",
> >>>>>>>>> "unreachable": true}
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-149-.us-west-2.compute.amazonaws.com]:
> UNREACHABLE! =>
> >>>>>>>>> {"changed": false, "msg": "Failed to connect to the host via
> ssh.",
> >>>>>>>>> "unreachable": true}
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> and:
> >>>>>>>>>
> >>>>>>>>> TASK [ambari_common : Add key pairs to existing authorized_keys]
> >>>>>>>>> ***************
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-187-.us-west-2.compute.amazonaws.com]: FAILED! =>
> >>>>>>>>> {"failed": true, "msg": "the file_name
> >>>>>>>>> '/tmp/keys/ec2-54-149-.us-west-2.compute.amazonaws.com.pub' does
> not exist,
> >>>>>>>>> or is not readable"}
> >>>>>>>>>
> >>>>>>>>> fatal: [ec2-54-187-.us-west-2.compute.amazonaws.com]: FAILED! =>
> >>>>>>>>> {"failed": true, "msg": "the file_name
> >>>>>>>>> '/tmp/keys/ec2-54-149-.us-west-2.compute.amazonaws.com.pub' does
> not exist,
> >>>>>>>>> or is not readable"}
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> There are some others, but in the end it fails the sanity check:
> >>>>>>>>>
> >>>>>>>>> TASK [Sanity check Ambari web]
> >>>>>>>>> *************************************************
> >>>>>>>>>
> >>>>>>>>> fatal: [localhost -> localhost]: FAILED! => {"changed": false,
> "elapsed":
> >>>>>>>>> 20, "failed": true, "msg": "Timeout when waiting for
> >>>>>>>>> ec2-54-149-.us-west-2.compute.amazonaws.com:8080"}
> >>>>>>>>>
> >>>>>>>>> to
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> I have tried re-running the ansible playbook.  The same errors
> reappear.
> >>>>>>>>> I have also tried using the —limit @playbook.retry flag.  Per
> the sanity
> >>>>>>>>> check, the Ambari master UI does not load.  Kibana loads the
> page, but does
> >>>>>>>>> not display any data.
> >>>>>>>>>
> >>>>>>>>> I could use some assistance in getting this working.  Thank you,
> >>>>>>>>>
> >>>>>>>>> Jimmy
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> --
> >>>>>>>> Nick Allen <nick@nickallen.org>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> Nick Allen <nick@nickallen.org>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>--
> >>>>>>Nick Allen <nick@nickallen.org>
> >>>>
> >>>>
> >>>>
> >>>>--
> >>>>Nick Allen <nick@nickallen.org>
> >>>>
> >
> >
> >
> >--
> >Nick Allen <nick@nickallen.org>
>

Mime
View raw message