hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "AmazonEC2" by DougCutting
Date Fri, 27 Oct 2006 22:07:09 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by DougCutting:
http://wiki.apache.org/lucene-hadoop/AmazonEC2

------------------------------------------------------------------------------
  
  == Security ==
  
- To access your cluster, you must enable access from at least port 22, for ssh.  Generally
it is also useful to open a few other ports, to view job progress.
+ To access your cluster, you must enable access from at least port 22, for ssh.  Generally
it is also useful to open a few other ports, to view job progress.  Port 50030 is used for
the JobTracker's web interface, permitting one to view job status, and port 50060 is used
by the TaskTracker's web interface, for more detailed debugging.
  
  {{{
  % ec2-add-group my-group
  % ec2-authorize my-group -p 22
  % ec2-authorize my-group -p 50030
  % ec2-authorize my-group -p 50060
+ }}}
+ 
+ Instances within the cluster should have unfettered access to one another.  This is enabled
by the following, replacing the XXXXXXXXXXX with your Amazon web services user id.
+ 
+ {{{
  % ec2-authorize my-group -o my-group -u XXXXXXXXXXX
  }}}
  
@@ -184, +189 @@

  % scp slaves master.mydomain.com:/usr/local/hadoop-X.X.X/conf/slaves
  }}}
  
+ Format the new cluster's filesystem.
+ 
+ {{{
+ % ssh master.mydomain.com
+ # /usr/local/hadoop-X.X.X/bin/hadoop namenode -format
+ }}}
+ 
+ Start the cluster.
+ 
+ {{{
+ # /usr/local/hadoop-X.X.X/bin/start-all.sh
+ }}}
+ 
+ Visit your cluster's web ui at http://master.mydomain.com:50030/.
+ 
+ == Shutting down your cluster ==
+ 
+ {{{
+ % ec2-terminate-instances `ec2-describe-instances | grep INSTANCE | cut -f 2`
+ }}}
+ 

Mime
View raw message