Return-Path: Delivered-To: apmail-lucene-hadoop-commits-archive@locus.apache.org Received: (qmail 37551 invoked from network); 8 Aug 2006 21:07:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 8 Aug 2006 21:07:29 -0000 Received: (qmail 71736 invoked by uid 500); 8 Aug 2006 21:07:29 -0000 Delivered-To: apmail-lucene-hadoop-commits-archive@lucene.apache.org Received: (qmail 71651 invoked by uid 500); 8 Aug 2006 21:07:28 -0000 Mailing-List: contact hadoop-commits-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-commits@lucene.apache.org Received: (qmail 71642 invoked by uid 99); 8 Aug 2006 21:07:28 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Aug 2006 14:07:28 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_HELO_PASS X-Spam-Check-By: apache.org Received: from [192.87.106.226] (HELO ajax.apache.org) (192.87.106.226) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Aug 2006 14:07:28 -0700 Received: from ajax.apache.org (localhost [127.0.0.1]) by ajax.apache.org (Postfix) with ESMTP id 50B2CD49BD for ; Tue, 8 Aug 2006 22:07:07 +0100 (BST) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: Apache Wiki To: hadoop-commits@lucene.apache.org Date: Tue, 08 Aug 2006 21:07:07 -0000 Message-ID: <20060808210707.10573.67411@ajax.apache.org> Subject: [Lucene-hadoop Wiki] Update of "FrontPage" by OwenOMalley X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification. The following page has been changed by OwenOMalley: http://wiki.apache.org/lucene-hadoop/FrontPage ------------------------------------------------------------------------------ = Hadoop = - [http://lucene.apache.org/hadoop/ Hadoop] is a framework for managing applications across large clusters of information in such a way that the application does not need to worry about either reliability or locality. Hadoop uses a computational paradigm named [:HadoopMapReduce: Map/Reduce], where the application is divided into many fragments of work, each of which may be executed or reexecuted on any computer in the cluster. To support locality-transparency, Hadoop stores persistent data in a distributed file system that is designed for large streaming reads and fault tolerance. + [http://lucene.apache.org/hadoop/ Hadoop] is a framework for running applications on large clusters built of commodity hardware. The Hadoop framework transparently provides applications both reliability and data motion. Hadoop implements a computational paradigm named [:HadoopMapReduce: Map/Reduce], where the application is divided into many small fragments of work, each of which may be executed or reexecuted on any node in the cluster. In addition, it provides a distributed file system that stores data on the compute nodes and thereby provides very high aggregate bandwidth across the cluster. Both Map/Reduce and the distributed file system are designed so that node failures are automatically handled by the network. The intent is to scale Hadoop up to handling thousand of computers. The current high water marks that have been reported are: * !DataNodes: 620