hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "AmazonEC2" by Smith Scott
Date Sat, 09 Jul 2011 09:18:50 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "AmazonEC2" page has been changed by Smith Scott:
http://wiki.apache.org/hadoop/AmazonEC2?action=diff&rev1=88&rev2=89

   1. The script ''create-hadoop-image-remote'' then installs Java, tools required to run
Hadoop, and Hadoop itself. Then it configures Hadoop:
     * In EC2, the local data volume is mounted as ''/mnt'', so logs are written under here.
     * ''hadoop-init'' is installed as an init script to be run on instance start up. This
takes advantage of an EC2 feature called [[http://developer.amazonwebservices.com/connect/entry.jspa?externalID=531&categoryID=100|parameterized
launches]]. For Hadoop, this allows the master hostname and the cluster size to be retrieved
when the Hadoop instance starts - this information is used to finish the Hadoop configuration.
-  1. Finally, ''create-hadoop-image-remote'' bundles the machine as an AMI, and uploads it
to S3. (Particular care has to be taken to ensure that no secrets, such as private keys, are
bundled in the AMI. See [[http://docs.amazonwebservices.com/AmazonEC2/dg/2006-10-01/public-ami-guidelines.html|here]]
for more details.) The AMI is stored in a bucket named by the variable `$S3_BUCKET` and with
the name `hadoop-$HADOOP_VERSION`.
+  1. Finally, ''create-hadoop-image-remote'' bundles the machine as an AMI, and uploads it
to S3. (Particular care has to be taken to ensure that no secrets, such as private keys, are
bundled in the AMI. See [[http://docs.amazonwebservices.com/AmazonEC2/dg/2006-10-01/public-ami-guidelines.html|here]]
[http://www.antianxietymedicationstreatment.com/|Anxiety Medication] for more details.) The
AMI is stored in a bucket named by the variable `$S3_BUCKET` and with the name `hadoop-$HADOOP_VERSION`.
   1. Control then returns to ''create-hadoop-image'' which registers the image with EC2.
  
  === Building a stock Hadoop image ===

Mime
View raw message