Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 13557 invoked from network); 19 Mar 2009 18:55:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 19 Mar 2009 18:55:23 -0000 Received: (qmail 14435 invoked by uid 500); 19 Mar 2009 18:55:15 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 14391 invoked by uid 500); 19 Mar 2009 18:55:15 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 14380 invoked by uid 99); 19 Mar 2009 18:55:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Mar 2009 11:55:15 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of milesosb@gmail.com designates 74.125.78.26 as permitted sender) Received: from [74.125.78.26] (HELO ey-out-2122.google.com) (74.125.78.26) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Mar 2009 18:55:07 +0000 Received: by ey-out-2122.google.com with SMTP id 25so98914eya.35 for ; Thu, 19 Mar 2009 11:54:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type:content-transfer-encoding; bh=ZezQ2MkhohERQPYLqa6c1T67nTla3oel6RKrR1pJ+Y8=; b=xpgr7V3oaTD2cMEp4XPXHCRevMdmX4/nTlOWVoLGn2M9k9J7ZaI087Yxf23ojEYgXF oHSfc/noCctzn7i0RI0YIzd9KcRo+VtcMf/W9sAmu7VW1pab1Sj38HYC2G+IxKkT4jNY zLr61BfM/miud9G/5QL1mXgkHhENCb1cBXyXY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=xbRRS0QIQFzT5JfrT+3zGqP7WiOzxCNjR+nISFbJt7kxe2uKUZEg77wCJUD1YauD5u dUKux8VD1+kq0KLgyKx5i7mezghBz1OQuBPrO51bT+jBfDsTnnr8QCvJCPIu/mnh3ALr xAXbAUMzmoXkCmGTCaUYRF2OVoRhOkCkdhTYw= MIME-Version: 1.0 Sender: milesosb@gmail.com Received: by 10.210.110.5 with SMTP id i5mr2116206ebc.18.1237488887362; Thu, 19 Mar 2009 11:54:47 -0700 (PDT) In-Reply-To: <2d24d9b20903191148j6fa4eed8ta5a0ff542fd48134@mail.gmail.com> References: <2d24d9b20903191148j6fa4eed8ta5a0ff542fd48134@mail.gmail.com> Date: Thu, 19 Mar 2009 18:54:47 +0000 X-Google-Sender-Auth: f2d8713121342c23 Message-ID: <73e5a5310903191154x212d5980vbb2eb1c5065f1c74@mail.gmail.com> Subject: Re: Will Hadoop help for my application? From: Miles Osborne To: core-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org yes, this is perfectly fine: make each mapper one of your runs and simply emit the final result, along with the conditions leading to that result. you won't need any reducers. Miles 2009/3/19 John Bergstrom : > Hi, > > Can anyone tell me if Hadoop is appropriate for the following application. > > I need to perform optimization using a single, small input data set. > To get a good result I must make many independent runs of the > optimizer, where each run is initiated with a different starting > point. At completion, I just choose the best solution from all of the > runs. So my problem is not that I'm working with big data, I just want > to speed up my run time by linking several Ubuntu desktops that are > available to me. The optimizer is written in ANSI C. > > Thanks, > > John > -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.