Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 73685 invoked from network); 13 Feb 2008 17:26:09 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 13 Feb 2008 17:26:09 -0000 Received: (qmail 7036 invoked by uid 500); 13 Feb 2008 17:26:00 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 7013 invoked by uid 500); 13 Feb 2008 17:26:00 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 7004 invoked by uid 99); 13 Feb 2008 17:26:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Feb 2008 09:26:00 -0800 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ahmad.humyn@gmail.com designates 66.249.82.231 as permitted sender) Received: from [66.249.82.231] (HELO wx-out-0506.google.com) (66.249.82.231) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Feb 2008 17:25:29 +0000 Received: by wx-out-0506.google.com with SMTP id i30so80012wxd.2 for ; Wed, 13 Feb 2008 09:25:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; bh=x+KuynhVyZzZpaFD2id58w4hXru4t8Qm4075GMhemZo=; b=A6Ujtk1gUq3fyKQNwpeLy9icU2fDK0afT3NxxQSjDrzEHwWMNLUqtbhQaP5uBKeOS+DAwKGjEYVIY/ppaN6NmnuA9FPgcEgn5p9TuWpOtlQBv8+cwgYawDvpGoXdY9ZN+JT06tCIieAQRlPHWoSKUag0R53JDFLgBAL8UqHfJaQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; b=vAgPa3nyeYO4xgPh7kB3bAMVMGtB+MhTFdMNITO9AF5tj2M4VCNPPNAsA813jg7KJRKWLE1uuom3CZOw9k6eEVGGJIZy0QKl0lQZOeJanaO/QpLzfcbsPX/zEnLsOxtjq5jQqG4UgYUJu+TKhYJcoX+Yontfo9UyqXQlruK2Eq0= Received: by 10.141.171.6 with SMTP id y6mr117234rvo.143.1202923533340; Wed, 13 Feb 2008 09:25:33 -0800 (PST) Received: by 10.140.177.3 with HTTP; Wed, 13 Feb 2008 09:25:33 -0800 (PST) Message-ID: <96d3bba10802130925r47ac2958o919da66c768dbf81@mail.gmail.com> Date: Wed, 13 Feb 2008 22:25:33 +0500 From: "Ahmad Humayun" To: core-dev@hadoop.apache.org Subject: Re: About the support of MapReduce task scheduling schemes In-Reply-To: <256fdd860802130918p6a592ec0v104229c350ebbc86@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_22650_25951479.1202923533303" References: <256fdd860802130821u682239b5xb400bf402f5367b2@mail.gmail.com> <96d3bba10802130903t6fd10c4dv68c90d785d185446@mail.gmail.com> <256fdd860802130918p6a592ec0v104229c350ebbc86@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_22650_25951479.1202923533303 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Its not a separate module, as far as I know, its just part of the whole Hadoop implementation. If you would like to use it somewhere else, it would take some serious surgery :) I'm sure you didn't want to hear this, but this is what I know. Although I'll recommend you to ask others too :) regards, On Feb 13, 2008 10:18 PM, Zhu Huijun wrote: > Thank you, Ahmad Humayun. I am not asking for the idea of MapReduce. What > I > am asking is the scheduling scheme in Hadoop. I am wondering whether the > scheduling module is a part of any library implemented in Hadoop, or the > scheduling of Hadoop is based on the infrastructure under which Hadoop is > installed. > > 2008/2/13, Ahmad Humayun : > > > > The ideas were originally published as MapReduce by Jeffrey > > Deanand Sanjay > > Ghemawat at Google. Have a look > at: > > http://labs.google.com/papers/mapreduce.html > > > > > > regards, > > > > On Feb 13, 2008 9:21 PM, Zhu Huijun wrote: > > > > > Dear all, > > > > > > Recently we are invesgating dynamic scheduling of parallel > IO-intensive > > > applications in large-scale cluster. We are interested in Hadoop, > > > especially > > > its task scheduling schemes. Is the scheduling module a part of any > > > library > > > of Hadoop, or is it a standalone library? Is there any publications > > > specific > > > on scheduling in Hadoop? Could you please share some details about > > > scheduling or suggest some literature of Hadoop? > > > > > > Thanks! > > > > > > Best wishes, > > > > > > Huijun Zhu > > > > > > > > > > > -- > > Ahmad Humayun > > Research Assistant > > Computer Science Dpt., LUMS > > +92 321 4457315 > > > -- Ahmad Humayun Research Assistant Computer Science Dpt., LUMS +92 321 4457315 ------=_Part_22650_25951479.1202923533303--