spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicholas Chammas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-5335) Destroying cluster in VPC with "--delete-groups" fails to remove security groups
Date Thu, 05 Feb 2015 22:28:35 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133
] 

Nicholas Chammas commented on SPARK-5335:
-----------------------------------------

For the record: [AWS says|https://forums.aws.amazon.com/thread.jspa?messageID=572559] you
must use the group ID (as opposed to the name) when deleting groups within a VPC.

> Destroying cluster in VPC with "--delete-groups" fails to remove security groups
> --------------------------------------------------------------------------------
>
>                 Key: SPARK-5335
>                 URL: https://issues.apache.org/jira/browse/SPARK-5335
>             Project: Spark
>          Issue Type: Bug
>          Components: EC2
>            Reporter: Vladimir Grigor
>
> When I try to remove security groups using option of the script, it fails because in
VPC one should remove security groups by id, not name as it is now.
> {code}
> $ ./spark-ec2 -k key20141114 -i ~/key.pem --region=eu-west-1 --delete-groups destroy
SparkByScript
> Are you sure you want to destroy the cluster SparkByScript?
> The following instances will be terminated:
> Searching for existing cluster SparkByScript...
> ALL DATA ON ALL NODES WILL BE LOST!!
> Destroy cluster SparkByScript (y/N): y
> Terminating master...
> Terminating slaves...
> Deleting security groups (this will take some time)...
> Waiting for cluster to enter 'terminated' state.
> Cluster is now in 'terminated' state. Waited 0 seconds.
> Attempt 1
> Deleting rules in security group SparkByScript-slaves
> Deleting rules in security group SparkByScript-master
> ERROR:boto:400 Bad Request
> ERROR:boto:<?xml version="1.0" encoding="UTF-8"?>
> <Response><Errors><Error><Code>InvalidParameterValue</Code><Message>Invalid
value 'SparkByScript-slaves' for groupName. You may not reference Amazon VPC security groups
by name. Please use the corresponding id for this operation.</Message></Error></Errors><RequestID>60313fac-5d47-48dd-a8bf-e9832948c0a6</RequestID></Response>
> Failed to delete security group SparkByScript-slaves
> ERROR:boto:400 Bad Request
> ERROR:boto:<?xml version="1.0" encoding="UTF-8"?>
> <Response><Errors><Error><Code>InvalidParameterValue</Code><Message>Invalid
value 'SparkByScript-master' for groupName. You may not reference Amazon VPC security groups
by name. Please use the corresponding id for this operation.</Message></Error></Errors><RequestID>74ff8431-c0c1-4052-9ecb-c0adfa7eeeac</RequestID></Response>
> Failed to delete security group SparkByScript-master
> Attempt 2
> ....
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message