hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-884) Create scripts to run Hadoop on Amazon EC2
Date Mon, 29 Jan 2007 21:23:49 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Tom White updated HADOOP-884:

    Attachment: hadoop-884.patch

The attached patch includes the Hadoop EC2 scripts in contrib/ec2/bin. I think they are ready
for inclusion in the main distribution now.

I have extended the scripts since the version in the tar.gz file by making them more robust:
they no longer have to be unpacked and invoked from the user's home directory. More significantly,
I have used a parameterized launch to set cluster size and master hostname. Previously, you
had to build an image for a particular cluster size and hostname - now you can build one image
and choose the cluster size and host  name at launch time. (This is a step towards shared
Hadoop images.)

As for the other improvements, I will create new Jira issues for them, since the basic scripts
are in a working state (although I would love feedback if anyone tries them out).

James - thank you for the suggestion about Zeroconf. I've not had any experience with it,
so any help would be appreciated.

> Create scripts to run Hadoop on Amazon EC2
> ------------------------------------------
>                 Key: HADOOP-884
>                 URL: https://issues.apache.org/jira/browse/HADOOP-884
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: scripts
>    Affects Versions: 0.10.1
>            Reporter: Tom White
>         Assigned To: Tom White
>         Attachments: hadoop-884.patch, hadoop-ec2-v1.tar.gz
> It is already possible to run Hadoop on Amazon EC2 (http://wiki.apache.org/lucene-hadoop/AmazonEC2),
however it is a rather involved, largely manual process. By writing scripts to automate (as
far as is possible) image creation and cluster launch it will make it much easier to use Hadoop
on EC2.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message