hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "AmazonEC2" by Smith Scott
Date Wed, 15 Jun 2011 07:25:28 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "AmazonEC2" page has been changed by Smith Scott:
http://wiki.apache.org/hadoop/AmazonEC2?action=diff&rev1=80&rev2=81

       * The default value for `S3_BUCKET` (`hadoop-ec2-images`) is for public images. Images
for Hadoop version 0.17.1 and later are in the `hadoop-images` bucket, so you should change
this variable if you want to use one of these images. You also need to change this if you
want to use a private image you have built yourself.      
     * ('''Pre 0.17''') Hadoop cluster variables (`GROUP`, `MASTER_HOST`, `NO_INSTANCES`)
       * `GROUP` specifies the private group to run the cluster in. Typically the default
value is fine.
-      * `MASTER_HOST` is the hostname of the master node in the cluster. You need to set
this to be a hostname that you have DNS control over - it needs resetting every time a cluster
is launched. Services such as [[http://www.dyndns.com/services/dns/dyndns/|DynDNS]] and [[http://developer.amazonwebservices.com/connect/thread.jspa?messageID=61609#61609|the
like]] make this fairly easy.
+      * `MASTER_HOST` is the hostname of the master node in the cluster. You need to set
this to be a hostname that you have DNS control over - it needs resetting every time a cluster
is launched. Services such as [[http://www.dyndns.com/services/dns/dyndns/|DynDNS]] and [[http://developer.amazonwebservices.com/connect/thread.jspa?messageID=61609#61609|the
like]] [[http://www.contractjobs.com|Contract Jobs]] make this fairly easy.
       * `NO_INSTANCES` sets the number of instances in your cluster. You need to set this.
Currently Amazon limits the number of concurrent instances to 20.
  
  == Running a job on a cluster (Pre 0.17) ==

Mime
View raw message