Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4C03E10DE4 for ; Wed, 5 Feb 2014 02:15:39 +0000 (UTC) Received: (qmail 18508 invoked by uid 500); 5 Feb 2014 02:15:31 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 18383 invoked by uid 500); 5 Feb 2014 02:15:31 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 18373 invoked by uid 99); 5 Feb 2014 02:15:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Feb 2014 02:15:30 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of anfernee.xu@gmail.com designates 209.85.217.171 as permitted sender) Received: from [209.85.217.171] (HELO mail-lb0-f171.google.com) (209.85.217.171) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Feb 2014 02:15:24 +0000 Received: by mail-lb0-f171.google.com with SMTP id c11so7097655lbj.16 for ; Tue, 04 Feb 2014 18:15:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=SgG1fALjX+b7IXh3QueUXPRsYIVAXmTad5DKPaYGHJE=; b=HBKd01m9OfsXCAUvfkmOTWGMqd6PJHzFPHB0BRn+EEuM7zIzDzZDEeNj9CT2bHpS3f ndu9ue5xcFNTVq7P7ZzXcqEui/SRQnXdZEN41bDvVN998jGymv1/bsXNlViMz1KjXjWh XZVCa4z5Rkqt/P/Mjw8fHLZSaFno4BXmpb3FQ63QTaoblpeZuyMN55BKtWIahmi0+Zsz NBG1NMeMg+/1KSOCH8i2z1V8gSOdW5oN3Zc6RU2v9rftfngbczpyjHglq5N5Nay1a9ih 6wMnanKOTJU0WFi04mRTdtfpNKapgc2FAWX4dLMhGqHGkxgmFwmGZRk8ZRgMAiKqLT+D KJhA== MIME-Version: 1.0 X-Received: by 10.112.72.170 with SMTP id e10mr13810lbv.43.1391566503543; Tue, 04 Feb 2014 18:15:03 -0800 (PST) Received: by 10.114.21.3 with HTTP; Tue, 4 Feb 2014 18:15:03 -0800 (PST) Date: Tue, 4 Feb 2014 18:15:03 -0800 Message-ID: Subject: org.apache.hadoop.yarn.server.resourcemanager.scheduler.Allocation explanation is wanted! From: Anfernee Xu To: user Content-Type: multipart/alternative; boundary=001a11c2425820072504f19f531e X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2425820072504f19f531e Content-Type: text/plain; charset=ISO-8859-1 Hi I'm reading YARN source code, in particular on RM as I need to implement a special resource scheduler other than the shipped impl such as capacity or fair scheduler, when looking at .FifoScheduler.allocate(ApplicationAttemptId, List, List, List, List) it returns org.apache.hadoop.yarn.server.resourcemanager.scheduler.Allocation, I would like to know the exact meaning of each field in Allocation, for example final List containers; Does it contains the list of potential containers where task or appMaster will run at? What happens if the list is empty? Another question is how container assignment is performed in scheduler, I think there's no container in RM initially before the first application is started. Is there any sequence diagram to describe the whole flow? -- --Anfernee --001a11c2425820072504f19f531e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi

I'm reading YARN source code, in= particular on RM as I need to implement a special resource scheduler other= than the shipped impl such as =A0capacity or fair scheduler, when looking = at=A0

.FifoScheduler.allocate(ApplicationAttemptId, List<R= esourceRequest>, List<ContainerId>, List<String>, List<St= ring>)

it returns=A0org.apache.hadoop.yarn.serv= er.resourcemanager.scheduler.Allocation, I would like to know the exact mea= ning of each field in=A0Allocation, for example

=A0 =A0 =A0 =A0final List<Container> containers;<= /div>

Does it contains the list of potential containers = where task or appMaster will run at? What happens if the list is empty?=A0<= /div>

Another question is how container assignment is performed in= scheduler, I think there's no container in RM initially before the fir= st application is started. Is there any sequence diagram to describe the wh= ole flow?



--
--Anfernee =A0
--001a11c2425820072504f19f531e--