spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From danosipov <>
Subject [GitHub] spark pull request: [SPARK-787] Add S3 configuration parameters to...
Date Mon, 08 Sep 2014 17:22:32 GMT
Github user danosipov commented on the pull request:
    @JoshRosen Yes, the credentials could be supplied in boto specific config files, but if
they're not there the spark_ec2 script will look in the env variables, and error out with
a message - see
    So this PR will not work for those who have the credentials in boto configs, but at least
it doesn't break anything.
    As far as security, EMR uses essentially the same method for transferring credentials
to the cluster nodes, so I don't think there are any additional concerns.

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message