Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 45650 invoked from network); 26 Feb 2009 17:11:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Feb 2009 17:11:23 -0000 Received: (qmail 82504 invoked by uid 500); 26 Feb 2009 17:11:20 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 82393 invoked by uid 500); 26 Feb 2009 17:11:20 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 82382 invoked by uid 99); 26 Feb 2009 17:11:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Feb 2009 09:11:20 -0800 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jason.hadoop@gmail.com designates 74.125.44.28 as permitted sender) Received: from [74.125.44.28] (HELO yx-out-2324.google.com) (74.125.44.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Feb 2009 17:11:11 +0000 Received: by yx-out-2324.google.com with SMTP id 8so428651yxb.29 for ; Thu, 26 Feb 2009 09:10:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=pl3ATqeHEFqld663nNefllytidRMyemSopJ8REkUCxA=; b=RQrZ1vyNurlCdPNRvD8l8zupIaAxolD/aqWBK8fTZJ1Epd0asYlyOulIxWzIiLTWix mu4GkV06AAvEu0an6H6kcpDYsf/vl3ByjGl1BW+2yRYDoXI5Q//4JZBa1EToTU/mgeoG 1mF20/w4E6wD0ge/wOCUe1/6Sr6QA99XBnDGA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=bfJebypmQ2x7m9zCIhOSdFnnYYig61e5fyj+z9bo61bCChjRfHfuujJlSKXcMikBRr Yb2p3bU5+txUlFDm7vjLd7UPoOKt5UyiIiQM6tzn8dQi87v9EqDkp22l3qpKuMX6TZ+I T/jFj8cXqzBY2gxCC8U2xLw6qau7pmjdd2RDQ= MIME-Version: 1.0 Received: by 10.231.19.70 with SMTP id z6mr2022464iba.24.1235668250451; Thu, 26 Feb 2009 09:10:50 -0800 (PST) In-Reply-To: <8F2A21D6-1ADC-45BA-85D1-49B1DBC6C669@cse.unl.edu> References: <1bd817da0902252304p639a36abva29c4410417208cc@mail.gmail.com> <870612.98226.qm@web53610.mail.re2.yahoo.com> <8F2A21D6-1ADC-45BA-85D1-49B1DBC6C669@cse.unl.edu> Date: Thu, 26 Feb 2009 09:10:50 -0800 Message-ID: <314098690902260910t2831a0afy8e91c439a71976e1@mail.gmail.com> Subject: Re: multiple datanodes on single node cluster From: jason hadoop To: core-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=00221532c75820df680463d56f20 X-Virus-Checked: Checked by ClamAV on apache.org --00221532c75820df680463d56f20 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit I think the advantage might be due to current locking structure that can pause the datanode during the block report or during large deletes. Once the lock granularity is finer and there is less chance of a long operation blocking the datanode, this will be less interesting. On Thu, Feb 26, 2009 at 5:04 AM, Brian Bockelman wrote: > Hey, > > I'd add it's possible, but not necessary for day-to-day operations. > > We've got one data node instance which manages 48 disks... the single node > can probably support all the disk activity you have. > > I'm not sure how certain activities, such as putting a node into the > hostsExclude, would work with multiple data nodes. One way to find out! > > Brian > > > On Feb 26, 2009, at 1:55 AM, lohit wrote: > > It is possible to run multiple datanodes. >> You would have to have separate conf file for each datanode, basically you >> need to have different datanode address (dfs.datanode.address and related) >> and different storage directories dfs.data.dir. Have different configs and >> start each datanode instance with different conf directory containing >> different conf file >> Lohit >> >> >> >> ----- Original Message ---- >> From: Ajit Ratnaparkhi >> To: core-dev@hadoop.apache.org >> Sent: Wednesday, February 25, 2009 11:04:15 PM >> Subject: multiple datanodes on single node cluster >> >> Hi all, >> >> Is it possible to run multiple datanode instances on single node hadoop >> cluster? >> >> How to do that? >> >> thanks, >> -Ajit >> > > --00221532c75820df680463d56f20--