brooklyn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aled Sage (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BROOKLYN-317) AWS-EC2 provisioning fails: doesn't get public ip when waiting for ssh-reachability
Date Sat, 23 Jul 2016 10:34:20 GMT
Aled Sage created BROOKLYN-317:
----------------------------------

             Summary: AWS-EC2 provisioning fails: doesn't get public ip when waiting for ssh-reachability
                 Key: BROOKLYN-317
                 URL: https://issues.apache.org/jira/browse/BROOKLYN-317
             Project: Brooklyn
          Issue Type: Bug
    Affects Versions: 0.9.0
            Reporter: Aled Sage


When using Brooklyn 0.10.0-SNAPSHOT...

When deploying an app in aws-ec2 singapore, one of the VMs failed to provision (failed to
reach port 22).

The workaround is to configure {{machineCreateAttempts}} on the location, setting it to a
number greater than 1. It will thus retry if the problem is encountered.

Looking at the node information, it only lists the private address (and the private hostname),
and not the public ip.

Looking in the jclouds wire log, the first result from the API call {{Action=DescribeInstances&InstanceId.1=i-20c2df84&Version=2012-06-01}}
only had the private address and not the public address.

In terms of timing, we first started polling for the instance details at 10:58:38,293, and
stopped polling at 10:58:56,764 (when the VM was "running"). At that point, the API responses
still did not have the public address. We then waiting for an ssh port to be reachable, which
timed out. We began to destroy the VM at 11:09:00,292 - the api result then included the public
IP.

I suspect that this will need to be fixed in jclouds: we'll need to poll again for the instance
details, rather than just waiting for one of the initial private/public addresses to be reachable.

{noformat}
Failed after 11m 12s: Error invoking start at VanillaSoftwareProcessImpl{id=mf8o2c7ef4}: RunNodesException:
error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1)
image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376],
scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery
and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058},
groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:

0 error[s]
Node failures:

1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84,
providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS
Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229],
hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680,
volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
	at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
	at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


1 error[s]

org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException:
Error invoking start at VanillaSoftwareProcessImpl{id=mf8o2c7ef4}: RunNodesException: error
running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1)
image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376],
scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery
and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058},
groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:

0 error[s]
Node failures:

1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84,
providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS
Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229],
hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680,
volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
	at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
	at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


1 error[s]
	at org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.propagate(EffectorUtils.java:318)
	at org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.access$100(EffectorUtils.java:285)
	at org.apache.brooklyn.core.mgmt.internal.EffectorUtils.handleEffectorException(EffectorUtils.java:326)
	at org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$2.handleException(EffectorTasks.java:90)
	at org.apache.brooklyn.util.core.task.DynamicSequentialTask.handleException(DynamicSequentialTask.java:469)
	at org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:417)
	at org.apache.brooklyn.util.core.task.BasicExecutionManager$SubmissionCallable.call(BasicExecutionManager.java:519)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException: RunNodesException:
error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1)
image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376],
scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery
and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058},
groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:

0 error[s]
Node failures:

1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84,
providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS
Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229],
hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680,
volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
	at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
	at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


1 error[s]
	at org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
	at org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:372)
	at org.apache.brooklyn.util.core.task.Tasks$2.get(Tasks.java:293)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.preStartAtMachineAsync(MachineLifecycleEffectorTasks.java:465)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocation(MachineLifecycleEffectorTasks.java:382)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocations(MachineLifecycleEffectorTasks.java:367)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.start(MachineLifecycleEffectorTasks.java:356)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:257)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:244)
	at org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$1.call(EffectorTasks.java:82)
	at org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:359)
	... 5 more
Caused by: java.util.concurrent.ExecutionException: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22,
2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery
and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058},
groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:

0 error[s]
Node failures:

1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84,
providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS
Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229],
hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680,
volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
	at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
	at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


1 error[s]
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
	at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:63)
	at org.apache.brooklyn.util.core.task.BasicTask.get(BasicTask.java:361)
	at org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:370)
	... 14 more
Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException: RunNodesException:
error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1)
image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376],
scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery
and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058},
groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:

0 error[s]
Node failures:

1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84,
providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS
Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229],
hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680,
volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
	at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
	at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


1 error[s]
	at org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
	at org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:1103)
	at org.apache.brooklyn.location.jclouds.JcloudsLocation.obtain(JcloudsLocation.java:626)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:459)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:449)
	at org.apache.brooklyn.util.core.task.Tasks.withBlockingDetails(Tasks.java:106)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:431)
	at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:407)
	... 6 more
Caused by: org.jclouds.compute.RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22,
2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery
and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058},
groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:

0 error[s]
Node failures:

1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84,
providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS
Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229],
hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680,
volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
	at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
	at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
	at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
	at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
	at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
	at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


1 error[s]
	at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:222)
	at org.jclouds.ec2.compute.EC2ComputeService.createNodesInGroup(EC2ComputeService.java:149)
	at org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:735)
	... 12 more
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message