Mailing-List: contact hadoop-commits-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-dev@lucene.apache.org
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
From: Apache Wiki <wikidiffs@apache.org>
To: hadoop-commits@lucene.apache.org
Date: Fri, 27 Oct 2006 20:57:15 -0000
Message-ID: <20061027205715.15336.89022@ajax.apache.org>
Subject: [Lucene-hadoop Wiki] Update of "AmazonEC2" by DougCutting

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by DougCutting:
http://wiki.apache.org/lucene-hadoop/AmazonEC2

------------------------------------------------------------------------------
  
  == Security ==
  
+ To access your cluster, you must enable access from at least port 22, for ssh.  Generally it is also useful to open a few other ports, to view job progress.
- To access your cluster, you must enable access from at least port 22, for ssh.
- 
- {{{
- % ec2-authorize default -p 22
- }}}
- 
- Hadoop uses ports between 50000 and 50100.  You can permit arbitrary access to your cluster from remote networks with:
- 
- {{{
- % ec2-authorize default -p 50000-50100
- }}}
- 
- CAUTION: This is very insecure.  With this configuration, all your DFS data is publicly readable, and anonymous users anywhere on the internet may submit jobs to your cluster, uploading arbitrary code.  To secure your cluster you should not open these ports to the public, but rather only to other hosts within the cluster.  Amazon's security group mechanisms make this possible.  The following is untested.
  
  {{{
  % ec2-add-group my-group
+ % ec2-authorize my-group -p 22
+ % ec2-authorize my-group -p 50030
+ % ec2-authorize my-group -p 50050
  % ec2-authorize my-group -o my-group -u XXXXXXXXXXX
  }}}
  
@@ -184, +175 @@

  % ec2-describe-instances
  }}}
  
+ Once instances are launched, register the first host listed in DNS with your master host name.
+ 
+ Create a slaves file containing the rest of the instances and copy it to the master.
+ 
+ {{{
+ % ec2-describe-instances | grep INSTANCE | cut -f 4 | tail +2 > slaves
+ % scp slaves master.mydomain.com:/usr/local/hadoop-X.X.X/conf/slaves
+ }}}
+