Return-Path: Delivered-To: apmail-lucene-hadoop-user-archive@locus.apache.org Received: (qmail 72938 invoked from network); 8 Jul 2006 02:08:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 8 Jul 2006 02:08:10 -0000 Received: (qmail 18819 invoked by uid 500); 8 Jul 2006 02:08:10 -0000 Delivered-To: apmail-lucene-hadoop-user-archive@lucene.apache.org Received: (qmail 18803 invoked by uid 500); 8 Jul 2006 02:08:09 -0000 Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-user@lucene.apache.org Delivered-To: mailing list hadoop-user@lucene.apache.org Received: (qmail 18793 invoked by uid 99); 8 Jul 2006 02:08:09 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Jul 2006 19:08:09 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [80.64.182.137] (HELO mslinux.media-style.com) (80.64.182.137) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Jul 2006 19:08:08 -0700 Received: from localhost (localhost [127.0.0.1]) by mslinux.media-style.com (Postfix) with ESMTP id 8C0E51446BA for ; Sat, 8 Jul 2006 04:07:47 +0200 (CEST) Received: from mslinux.media-style.com ([127.0.0.1]) by localhost (mslinux.media-style.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 22156-09 for ; Sat, 8 Jul 2006 04:07:47 +0200 (CEST) Received: from [192.168.50.64] (dsl017-055-128.sfo1.dsl.speakeasy.net [69.17.55.128]) by mslinux.media-style.com (Postfix) with ESMTP id E7A3514466D for ; Sat, 8 Jul 2006 04:07:46 +0200 (CEST) Mime-Version: 1.0 (Apple Message framework v752.2) In-Reply-To: <20060707165819.12757.qmail@web50305.mail.yahoo.com> References: <20060707165819.12757.qmail@web50305.mail.yahoo.com> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Stefan Groschupf Subject: Re: Hadoop production-ready? Date: Fri, 7 Jul 2006 19:07:45 -0700 To: hadoop-user@lucene.apache.org X-Mailer: Apple Mail (2.752.2) X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at media-style.com X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Hi Otis, I think this is difficult to answer. Just some points from my perspective. I use it in two projects in production but not the latest trunk. Map reduce works great and stable in my scale (up to 20 boxes). I lost several times data from the dfs so this is tricky. Watch out that you better never touch your network setup. If it runs once my experience is that it runs. However making backups from important data to a "normal" file system is a good idea. However hadoop related problems are fixed in a amazing short time frame. .. just my personal perspective. Stefan On 07.07.2006, at 09:58, Otis Gospodnetic wrote: > Hi, > > Sorry for the nature of the question, but can anyone estimate when > Hadoop will be "stable and production-ready"? I know you've run it > on clusters with 600+ nodes, but you guys (hadoop-dev) know this > beast inside out, and can spend time troubleshooting and fixing its > problems, but for somebody who is unable to do that, when do you > think it will be as stable as Nutch and Lucene are, for example? > > I'm asking because I see a LOT of fast development, but also see > that things being worked on are all non-trivial and still very much > in the core. > > Thanks, > Otis > > > > >