Return-Path: 
 <user-return-18921-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 096DC17BA3
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Tue,  3 Mar 2015 02:54:17 +0000 (UTC)
Received: (qmail 99452 invoked by uid 500); 3 Mar 2015 02:54:10 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 99357 invoked by uid 500); 3 Mar 2015 02:54:10 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 99346 invoked by uid 99); 3 Mar 2015 02:54:09 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2015 02:54:09 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW
X-Spam-Check-By: apache.org
Received-SPF: error (nike.apache.org: local policy)
Received: from [209.85.218.51] (HELO mail-oi0-f51.google.com) (209.85.218.51)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2015 02:53:43 +0000
Received: by mail-oi0-f51.google.com with SMTP id g201so30765192oib.10
        for <user@hadoop.apache.org>; Mon, 02 Mar 2015 18:51:05 -0800 (PST)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20130820;
        h=x-gm-message-state:mime-version:from:date:message-id:subject:to
         :content-type;
        bh=Wa/bcdhWqZ/Gx38Y9LG2cpzVKU2/Agt15fhe47dohyg=;
        b=FCjOg8KXHNWMvuJbONZyfTWp+nx3vahshH+3K7j7SurAteuRyLEA/e0oC9yNTmZaZs
         SWgAg/pTYsiNNZtwCgDjFe8TP3YhGgQNIKfuLH9j9cBTW2fHwNhWJ+C5sIz/WBsED5tC
         i8j+KF+Yn70kjs7GJ+oQfazNcuLo2H0hnZheILw8rBsGFt8GzmJteV2DIEzH18d0mOK0
         DQTTSyjOhoUCQO9b8RNVijaaFW5Sc0p/HIE8VQHBIP1QJKGBCL94rVtXaIr8RnnvluAy
         ea7DKkhvlEAs+1ItiEXAjK1dR2X1IDumz//rDpzEUADp5pmp5PlnRr+gHWj9g36WsLJe
         JGpg==
X-Gm-Message-State: 
 ALoCoQle6Bzj1H0BBGTnKFXOIhtoD25f81fKlLEtAm0VHhRR7L4V7yNXBNfUZuXB92bJVJ8sqKfg
X-Received: by 10.182.248.161 with SMTP id yn1mr21141877obc.25.1425351065698;
 Mon, 02 Mar 2015 18:51:05 -0800 (PST)
MIME-Version: 1.0
Received: by 10.202.178.5 with HTTP; Mon, 2 Mar 2015 18:50:45 -0800 (PST)
X-Originating-IP: [90.154.72.245]
From: =?UTF-8?B?0J/QsNCy0LXQuyDQnNC10LfQtdC90YbQtdCy?= <pavel@mezentsev.org>
Date: Tue, 3 Mar 2015 05:50:45 +0300
Message-ID: 
 <CAJ2A=Y90=ZxisHx7xLJ8vcH8xtr6mfzM-+-Z7L0+tMLd6gX8bQ@mail.gmail.com>
Subject: Push or pull in yarn
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c2a8acf39ffe05105967e2
X-Virus-Checked: Checked by ClamAV on apache.org

--001a11c2a8acf39ffe05105967e2
Content-Type: text/plain; charset=UTF-8

Hi All!


Resently I read an article about facebook's corona
https://www.facebook.com/notes/facebook-engineering/under-the-hood-scheduling-mapreduce-jobs-more-efficiently-with-corona/10151142560538920

they solved in mr1 pull based task assignment:
task trackers send heartbeat to jobtracker and recive new tasks  in
respond.
This approach wasted 10-20 seconds for each tasks.

My question is about YARN: was this trouble solved in YARN or not?

Best regards,
Mezentsev Pavel

--001a11c2a8acf39ffe05105967e2
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi All!</div><div><br></div><div><br></div><div>Resen=
tly I read an article about facebook&#39;s corona</div><a href=3D"https://w=
ww.facebook.com/notes/facebook-engineering/under-the-hood-scheduling-mapred=
uce-jobs-more-efficiently-with-corona/10151142560538920">https://www.facebo=
ok.com/notes/facebook-engineering/under-the-hood-scheduling-mapreduce-jobs-=
more-efficiently-with-corona/10151142560538920</a><div><br></div><div>they =
solved in mr1 pull based task assignment:=C2=A0</div><div>task trackers sen=
d heartbeat to jobtracker and recive new tasks =C2=A0in respond.=C2=A0</div=
><div>This approach wasted 10-20 seconds for each tasks.</div><div><br></di=
v><div>My question is about YARN: was this trouble solved in YARN or not?</=
div><div><br></div><div>Best regards,</div><div>Mezentsev Pavel
</div></div>

--001a11c2a8acf39ffe05105967e2--