hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4117) Improve configurability of Hadoop EC2 instances
Date Mon, 08 Sep 2008 19:11:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tom White updated HADOOP-4117:
------------------------------

    Attachment: hadoop-4117.patch

This patch passes the boot script as user data to the EC2 instance on launch. This makes it
easy to change config by editing the boot script. You can change other config in the script
too. For example, it would be the obvious place to add set up code for HBase (see HBASE-838).
I've also changed the script to fix HADOOP-3783.

> Improve configurability of Hadoop EC2 instances
> -----------------------------------------------
>
>                 Key: HADOOP-4117
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4117
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: contrib/ec2
>            Reporter: Tom White
>            Assignee: Tom White
>             Fix For: 0.19.0
>
>         Attachments: hadoop-4117.patch
>
>
> Currently hadoop-site.xml for EC2 instances is stored as a part of the image and only
a few properties can be controlled from the user scripts (compression, number of map/reduce
tasks). Furthermore, it is not possible to rsync the configuration around the EC2 cluster
with the current image, so the only way to customize the hadoop-site.xml file is to rebuild
the image, which is time-consuming.
> It would be much better to pass the initialization script for nodes at boot time, so
that it is easy to edit the configuration before starting a cluster.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message