hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "AmazonEC2" by DougCutting
Date Fri, 27 Oct 2006 20:57:15 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by DougCutting:
http://wiki.apache.org/lucene-hadoop/AmazonEC2

------------------------------------------------------------------------------
  
  == Security ==
  
+ To access your cluster, you must enable access from at least port 22, for ssh.  Generally
it is also useful to open a few other ports, to view job progress.
- To access your cluster, you must enable access from at least port 22, for ssh.
- 
- {{{
- % ec2-authorize default -p 22
- }}}
- 
- Hadoop uses ports between 50000 and 50100.  You can permit arbitrary access to your cluster
from remote networks with:
- 
- {{{
- % ec2-authorize default -p 50000-50100
- }}}
- 
- CAUTION: This is very insecure.  With this configuration, all your DFS data is publicly
readable, and anonymous users anywhere on the internet may submit jobs to your cluster, uploading
arbitrary code.  To secure your cluster you should not open these ports to the public, but
rather only to other hosts within the cluster.  Amazon's security group mechanisms make this
possible.  The following is untested.
  
  {{{
  % ec2-add-group my-group
+ % ec2-authorize my-group -p 22
+ % ec2-authorize my-group -p 50030
+ % ec2-authorize my-group -p 50050
  % ec2-authorize my-group -o my-group -u XXXXXXXXXXX
  }}}
  
@@ -184, +175 @@

  % ec2-describe-instances
  }}}
  
+ Once instances are launched, register the first host listed in DNS with your master host
name.
+ 
+ Create a slaves file containing the rest of the instances and copy it to the master.
+ 
+ {{{
+ % ec2-describe-instances | grep INSTANCE | cut -f 4 | tail +2 > slaves
+ % scp slaves master.mydomain.com:/usr/local/hadoop-X.X.X/conf/slaves
+ }}}
+ 

Mime
View raw message