hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6108) Add support for EBS storage on EC2
Date Thu, 15 Oct 2009 12:14:31 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tom White updated HADOOP-6108:
------------------------------

    Attachment: HADOOP-6108.patch

Here is a new patch which provides EBS support, amongst other things.

The scripts have been refactored to make it easy to support other providers. The current patch
does not include anything other than EC2, but the plan is to add other providers, perhaps
by using libcloud (http://libcloud.org/). Since the scripts are no longer EC2 specific they
are under src/contrib/cloud.

These new scripts are a superset of the the bash scripts (in src/contrib/ec2) and are intended
to replace them. They are also more amenable to testing (there are some unit tests included).

There are also integration (functional) tests for testing running a MapReduce job on a transient
and a persistent (EBS) cluster.

> Add support for EBS storage on EC2
> ----------------------------------
>
>                 Key: HADOOP-6108
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6108
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: contrib/ec2
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: HADOOP-6108.patch
>
>
> By using EBS for namenode and datanode storage we can have persistent, restartable Hadoop
clusters running on EC2.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message