Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 76029 invoked from network); 6 Jul 2006 17:43:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 6 Jul 2006 17:43:32 -0000 Received: (qmail 13994 invoked by uid 500); 6 Jul 2006 17:43:27 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 13892 invoked by uid 500); 6 Jul 2006 17:43:26 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 13845 invoked by uid 99); 6 Jul 2006 17:43:26 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jul 2006 10:43:26 -0700 X-ASF-Spam-Status: No, hits=1.4 required=10.0 tests=DNS_FROM_RFC_ABUSE,DNS_FROM_RFC_WHOIS X-Spam-Check-By: apache.org Received-SPF: neutral (asf.osuosl.org: local policy) Received: from [207.126.228.150] (HELO rsmtp2.corp.yahoo.com) (207.126.228.150) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jul 2006 10:43:23 -0700 Received: from [207.126.231.236] (eric14-mac.corp.yahoo.com [207.126.231.236]) (authenticated bits=0) by rsmtp2.corp.yahoo.com (8.13.6/8.13.6/y.rout) with ESMTP id k66Hgruq014872 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NO) for ; Thu, 6 Jul 2006 10:42:54 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=mime-version:in-reply-to:references:content-type:message-id: content-transfer-encoding:from:subject:date:to:x-mailer; b=L099uGs9MeMQVzJOAnOtW+1GoCCHQvnjCGiFqXVf/wl6c5HMNeJdMnvTCVtVgJrY Mime-Version: 1.0 (Apple Message framework v752.2) In-Reply-To: References: Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Eric Baldeschwieler Subject: Re: Stopping datanode and namenode Date: Thu, 6 Jul 2006 10:42:50 -0700 To: hadoop-dev@lucene.apache.org X-Mailer: Apple Mail (2.752.2) X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Thats sounds cool. Sounds like something that would be great in the examples directory. Then we could put some regressions in place to make sure we don't break it as we uplevel things too. Might it make more sense to run the datanode as a distinct process and use the client in your servelet? I'm no expert on web farms, just curious. On Jul 6, 2006, at 1:03 AM, barry.kaplan@gmail.com wrote: > I am not sure of what you are asking, but we are using DFS inside our > servlet, which runs in tomcat, to allow us to distribute files in a > cleaner, easier, method then an NFS share. > > To make things easier for us (especially operations) we have each of > our servlets act as a datanode. This way each of our servers (web > server), which only uses around 10GB of disk space, can take advantage > of the rather cheap 40-100GB drives that are in them for the purpose > of DFS.