hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4117) Improve configurability of Hadoop EC2 instances
Date Wed, 17 Sep 2008 20:29:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tom White updated HADOOP-4117:
------------------------------

    Attachment: hadoop-4117-v2.patch

I did a local chmod and it worked - I've used these scripts a few times. But here's a new
patch where the file's mode is changed on the instance, which should be more reliable (although
scp -p would be an alternative).

> Improve configurability of Hadoop EC2 instances
> -----------------------------------------------
>
>                 Key: HADOOP-4117
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4117
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: contrib/ec2
>            Reporter: Tom White
>            Assignee: Tom White
>             Fix For: 0.19.0
>
>         Attachments: hadoop-4117-v2.patch, hadoop-4117.patch
>
>
> Currently hadoop-site.xml for EC2 instances is stored as a part of the image and only
a few properties can be controlled from the user scripts (compression, number of map/reduce
tasks). Furthermore, it is not possible to rsync the configuration around the EC2 cluster
with the current image, so the only way to customize the hadoop-site.xml file is to rebuild
the image, which is time-consuming.
> It would be much better to pass the initialization script for nodes at boot time, so
that it is easy to edit the configuration before starting a cluster.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message