Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A52CCC2E1 for ; Sat, 9 Aug 2014 09:42:47 +0000 (UTC) Received: (qmail 30578 invoked by uid 500); 9 Aug 2014 09:42:46 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 30513 invoked by uid 500); 9 Aug 2014 09:42:46 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 30501 invoked by uid 99); 9 Aug 2014 09:42:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Aug 2014 09:42:46 +0000 X-ASF-Spam-Status: No, hits=0.2 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sirotin8@web.de designates 212.227.15.3 as permitted sender) Received: from [212.227.15.3] (HELO mout.web.de) (212.227.15.3) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Aug 2014 09:42:19 +0000 Received: from [192.168.178.20] ([37.5.81.102]) by smtp.web.de (mrweb003) with ESMTPSA (Nemesis) id 0Lc8aj-1WWVCR1R13-00jZmO for ; Sat, 09 Aug 2014 11:42:18 +0200 Message-ID: <53E5ECF6.2040604@web.de> Date: Sat, 09 Aug 2014 11:42:14 +0200 From: Alexander Sirotin User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: user@giraph.apache.org Subject: Re: Hadoop Multi Node Cluster Configuration References: <53E56B9C.1010505@gmail.com> <53E5EBF5.5030205@web.de> In-Reply-To: <53E5EBF5.5030205@web.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K0:mSrGni/XO5dpwKqQnC6Ih6d2GvDTaLRk3T01msoJwlcPJuQY6wq 10t8gkJsQdotFEFjNoz3tLLl7OPDb4otNhUcvWC/v+345T7/UVr2Hhc+p677r7E+QprbqhO 1X7RO/WIIp6Su6AluYV942GicSvWnq/IBmwU92PZqyh6gY7+S1XfZGq2rqCEkvJpfPQgGUZ jiHQ9/O24U8DjikL8jEpA== X-UI-Out-Filterresults: notjunk:1; X-Virus-Checked: Checked by ClamAV on apache.org my mistake: Machine 1: NameNode (Master) and SecondaryNameNode (Master) Machine 2: ResourceManager (Master) and ProxyServer (Master) Machine 3,4,5: DataNode (Slave) and NodeManager (Slave) On 09.08.2014 11:37, Alexander Sirotin wrote: > Hi, > > I am not an expert, but I am running a 5 machine cluster. > > I do the following. > > Machine 1: DataNode and NodeManager > Machine 2: ResourceManager (Yarn-Master) and ProxyServer > Machine 3,4,5: NameNode and SecondaryNameNode > > If you like you can also start the slave-processes also on the > master-machines, so you are also using the diskspace of these. For me > it is not neccessary yet and I am using the master-nodes dedicatedly. > > To define you just put into the hostname or ip-address into > etc/hadoop/[masters|slaves]. 1 host per line > > Best regards > > > On 09.08.2014 02:30, xeniad20 wrote: >> Hi experts, >> >> What is the best for multinode Hadoop configuration in a small >> cluster with 4 machines only. >> >> How can we define master, secondarynamenode and datanodes in the >> /hadoop/conf/masters and slaves files? >> >> Thanks >