Return-Path: Delivered-To: apmail-lucene-hadoop-user-archive@locus.apache.org Received: (qmail 51878 invoked from network); 14 Mar 2007 09:43:03 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 14 Mar 2007 09:43:03 -0000 Received: (qmail 67235 invoked by uid 500); 14 Mar 2007 09:43:09 -0000 Delivered-To: apmail-lucene-hadoop-user-archive@lucene.apache.org Received: (qmail 67213 invoked by uid 500); 14 Mar 2007 09:43:09 -0000 Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-user@lucene.apache.org Delivered-To: mailing list hadoop-user@lucene.apache.org Received: (qmail 67200 invoked by uid 99); 14 Mar 2007 09:43:08 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 Mar 2007 02:43:08 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_HELO_PASS X-Spam-Check-By: apache.org Received-SPF: neutral (herse.apache.org: local policy) Received: from [212.227.126.183] (HELO moutng.kundenserver.de) (212.227.126.183) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 Mar 2007 02:42:57 -0700 Received: from [84.158.217.163] (helo=[192.168.0.2]) by mrelayeu.kundenserver.de (node=mrelayeu5) with ESMTP (Nemesis), id 0ML25U-1HRQ0B19Os-0006tf; Wed, 14 Mar 2007 10:42:35 +0100 Message-ID: <45F7D1A2.2090708@sabre-labs.com> Date: Wed, 14 Mar 2007 11:42:42 +0100 From: Simon Willnauer User-Agent: Thunderbird 1.5.0.10 (X11/20070303) MIME-Version: 1.0 To: Timothy Chklovski , hadoop-user@lucene.apache.org Subject: Re: Hadoop suitable for production References: <45F70C9C.50800@sabre-labs.com> <73843d010703131717k1fc5e1e3v692e632be432daed@mail.gmail.com> In-Reply-To: <73843d010703131717k1fc5e1e3v692e632be432daed@mail.gmail.com> X-Enigmail-Version: 0.94.2.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Provags-ID: V01U2FsdGVkX19Fk0BQIou7jS0uRwVok179v/GebywG8PUw93+ hpcfZH4F2NocgaN6T8vi5XxHpqPCm1y0Na6s6hCH/ooZG+SzSG p432SPD+DZ0q+LZYNnfIg== X-Virus-Checked: Checked by ClamAV on apache.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Thanks Timothy for your short answer, I guess I have to be a bit more specific! Actually I'm interested in the distributed FS rather than in the Map/Reduce features. Did the HDFS change very much since it has been moved out of the nutch project?As far as I can tell the version of hadoop is a very very early one but this hasn't been developed from the scratch right? I can remember that nutch has been around for a while and nutch does make use of HDFS as well. Is there anybody around who runs hadoop in a production env. at all? Timothy talked about "major bugs" still coming up, so are they rather related to new features or also to the DFS? (I don't need details don't worry) What I need to know is if it is worth to use HDFS to build a prototype and a proof of concept for an upcoming project. If we can not use it due to it's early dev. state it's ok but we could save heaps of time with some information or recommendations. thank you for your answer, simon - -------------- mailto:simonw@apache.org Timothy Chklovski wrote: > not at all suitable major bugs still come up > > best, > > --tim > > On 3/13/07, *Simon Willnauer* > wrote: > > Hi Hadoops, recently I read an article in a well known German IT > magazine about Hadoop and HDFS. Eventually the article says that > hadoop is currently not suitable for a production deployment as it > is in a early development state. As far as I know has hadoop been > in development for a while and formerly known as Nutch DFS, is that > right?! Can you confirm that the current state of the distributed > file system is ready for production purpose?! > > Best regards > > Simon -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFF99Git+xRb3/rTZURApiNAKDxIiq0J5nA6yoHojKWCPtQjMT1uACeMpIv 0qXgrJPqhmiWBvdCVX5ZM/g= =l4Sj -----END PGP SIGNATURE-----