Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 72657 invoked from network); 19 Mar 2009 21:41:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 19 Mar 2009 21:41:32 -0000 Received: (qmail 32780 invoked by uid 500); 19 Mar 2009 21:41:29 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 32770 invoked by uid 500); 19 Mar 2009 21:41:29 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 32759 invoked by uid 99); 19 Mar 2009 21:41:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Mar 2009 14:41:29 -0700 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of amansk@gmail.com designates 209.85.198.236 as permitted sender) Received: from [209.85.198.236] (HELO rv-out-0506.google.com) (209.85.198.236) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Mar 2009 21:41:21 +0000 Received: by rv-out-0506.google.com with SMTP id k40so732787rvb.29 for ; Thu, 19 Mar 2009 14:41:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=gu2jYNnF0DK2ZFBoQaS6rM6s0D0OiS9G0Np8alIR0LE=; b=phdxRgoksVSKpXl/m4nLa/IUSuuQB8iqnGI2KZctsY9ip9bAInjLBFsYr95yO9mBjp BsJ0+EWJEOzRxER75Zlhlux03Dalemr7gn/lFzP5XcvAuZXds1vspljKXju5pDwFF2oC aUFtsDIJetw3sfVGx13eCl5D2ELzaGy5BLBPo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=ZUJWFekLxbdad5xltiGjIvtV2ypnDHkUJXQg2L75MdJlOe1kXPfs2UsR08e3WebdVI DOuKZ826STDeNR9JUFA9edkBLW3StviQ/i+l9SWrZkdKeIwZoMtBBBU8DwVLBEmOyKKV 5HYEVIfr8TEhuTW3oD426Y7bPH5oQOEDktMz4= MIME-Version: 1.0 Received: by 10.141.29.14 with SMTP id g14mr983956rvj.150.1237498861681; Thu, 19 Mar 2009 14:41:01 -0700 (PDT) In-Reply-To: <35a22e220903191440p5e2cb2f4i411b24b73cd4d3eb@mail.gmail.com> References: <2fe659f00903180933g10861d0dw898c40abd68968c4@mail.gmail.com> <195DB84A-A87C-4FD8-9D1A-961A6C3B7644@wensel.net> <35a22e220903191440p5e2cb2f4i411b24b73cd4d3eb@mail.gmail.com> Date: Thu, 19 Mar 2009 14:41:01 -0700 Message-ID: <35a22e220903191441t769936d0i4c9127ecaeeef343@mail.gmail.com> Subject: Re: Dryad support From: Amandeep Khurana To: core-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=000e0cd179900f7b5904657fa8c8 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd179900f7b5904657fa8c8 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Unless someone wants to start up an open source for that.. :) Amandeep Khurana Computer Science Graduate Student University of California, Santa Cruz On Thu, Mar 19, 2009 at 2:40 PM, Amandeep Khurana wrote: > Dryad isnt available outside MS and some univs... > > > Amandeep Khurana > Computer Science Graduate Student > University of California, Santa Cruz > > > > On Thu, Mar 19, 2009 at 2:37 PM, Chris K Wensel wrote: > >> I do not believe Dryad is available outside of MS and some universities. >> >> That said, Dryad is finer grained than MapReduce. That is, you would build >> MapReduce using Dryad model elements, not the other way around. >> >> Further, it offers no persistence layer, Cosmos FS is internal to MS and >> seems to have low regard. The typical model is running Dryad over a MS SQL >> Server cluster (partitioned tables). >> >> If you are really referring to DryadLINQ like functionality (an API that >> offers up the ability to chain explicit relational/set operations), I >> suggest you take a look at Cascading. >> >> cheers, >> ckw >> >> >> On Mar 18, 2009, at 9:45 AM, Chidambaran Kollengode wrote: >> >> Is Dryad available externally? >>> >>> -----Original Message----- >>> From: Yingfeng Zhang [mailto:yingfeng.zhang@gmail.com] >>> Sent: Wednesday, March 18, 2009 10:04 PM >>> To: core-dev@hadoop.apache.org >>> Subject: Dryad support >>> >>> Hi, I wonder if there exist any possible trying to add a Dryad layer >>> into >>> Hadoop, has any plan to do such a work? >>> >>> >>> Best >>> Yingfeng >>> >> >> -- >> Chris K Wensel >> chris@wensel.net >> http://www.cascading.org/ >> http://www.scaleunlimited.com/ >> >> > --000e0cd179900f7b5904657fa8c8--