Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5AFF718864 for ; Wed, 3 Feb 2016 23:42:51 +0000 (UTC) Received: (qmail 20565 invoked by uid 500); 3 Feb 2016 23:42:47 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 20462 invoked by uid 500); 3 Feb 2016 23:42:47 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 20450 invoked by uid 99); 3 Feb 2016 23:42:46 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Feb 2016 23:42:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 304D11A0528 for ; Wed, 3 Feb 2016 23:42:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.897 X-Spam-Level: * X-Spam-Status: No, score=1.897 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=connexity.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id B9Jnaf2at6aE for ; Wed, 3 Feb 2016 23:42:43 +0000 (UTC) Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1bon0080.outbound.protection.outlook.com [157.56.111.80]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id BD28325426 for ; Wed, 3 Feb 2016 23:42:42 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=connexity.com; s=selector1; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=6qEhL0bRigxVdecN3CtYjRi7qVAg9BgxgcyTvh+SQ+Q=; b=Bd+FwkH8nAS+hhB3EjIwpIuGy5Atmc6xcLwJWzEN7YPFNJdG4ZCdlk6NxGyu3v9eB9lq48hVqVK2ROZX6LFdDRSzuYqEs3/zGy8eb87DCzKCI5449kNX4N9Wiw/j6R9rYxDWiOyxEfzkZK/hrHrAwUF2O7PDsPresR+z9sTfog0= Received: from BY2PR0201MB0679.namprd02.prod.outlook.com (10.160.124.150) by BY2PR0201MB0679.namprd02.prod.outlook.com (10.160.124.150) with Microsoft SMTP Server (TLS) id 15.1.396.15; Wed, 3 Feb 2016 23:42:35 +0000 Received: from BY2PR0201MB0679.namprd02.prod.outlook.com ([10.160.124.150]) by BY2PR0201MB0679.namprd02.prod.outlook.com ([10.160.124.150]) with mapi id 15.01.0396.020; Wed, 3 Feb 2016 23:42:35 +0000 From: Randy Fox To: "user@hadoop.apache.org" Subject: Preemption and the rerunning of mappers Thread-Topic: Preemption and the rerunning of mappers Thread-Index: AQHRXtyOZyNI8mXyoEC3AFG0pcOoBA== Date: Wed, 3 Feb 2016 23:42:34 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: hadoop.apache.org; dkim=none (message not signed) header.d=none;hadoop.apache.org; dmarc=none action=none header.from=connexity.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [68.237.174.38] x-microsoft-exchange-diagnostics: 1;BY2PR0201MB0679;5:juA51zyrEe3DEduVshuUxBt320wmCEQfker5BPGruZZQNe24ZvRRaLFxcEeSkeHn51UJr8yHZeOrfpuv6jQHYeXoSe1DdAC7FEAiF8gqH3rpME49BJNBpS2y3HD+qgS7/sCxcrFCi9zMDi4KQr15yQ==;24:85l2Cax8GDghFboNUbgOCiCUJuAWQzrKrdTGkzz+zjghCw0hJ1xZdNd7Q/T2VzZXJRojZn/o4dgQn7oAmBHb23X44Z4lPN1tsbbgl1nogfQ= x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY2PR0201MB0679; x-ms-office365-filtering-correlation-id: 2588af6d-6c1d-4c75-ffca-08d32cf3b13a x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001);SRVR:BY2PR0201MB0679;BCL:0;PCL:0;RULEID:;SRVR:BY2PR0201MB0679; x-forefront-prvs: 08417837C5 x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(6009001)(51874003)(122556002)(54356999)(83716003)(87936001)(50986999)(1220700001)(2906002)(3280700002)(2351001)(1096002)(229853001)(86362001)(102836003)(106116001)(2501003)(6116002)(99286002)(5004730100002)(586003)(189998001)(3846002)(16236675004)(33656002)(92566002)(82746002)(5002640100001)(36756003)(5008740100001)(450100001)(66066001)(3660700001)(40100003)(10400500002)(5001960100002)(107886002)(77096005)(2900100001)(11100500001)(104396002);DIR:OUT;SFP:1101;SCL:1;SRVR:BY2PR0201MB0679;H:BY2PR0201MB0679.namprd02.prod.outlook.com;FPR:;SPF:None;MLV:sfv;LANG:en; spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_D7082A9589A14118AA58848E9834E436connexitycom_" MIME-Version: 1.0 X-OriginatorOrg: connexity.com X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Feb 2016 23:42:34.8668 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 19b787c6-eda8-4ed1-b67e-e60e112f8d2f X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR0201MB0679 --_000_D7082A9589A14118AA58848E9834E436connexitycom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 V2UgaGF2ZSBhIGNsdXN0ZXIgd2hlcmUgd2UgaGF2ZSBib3RoIHF1aWNrIGFuZCBsb25nIHJ1bm5p bmcgam9icy4gIFRoZSBsb25nIHJ1bm5pbmcgam9icyBhcmUgbWFwcGVycyB0aGF0IHRha2UgMSsg aG91cnMgYW5kIHJlZHVjZXJzIHRoYXQgdGFrZSAxK2hvdXJzIGFuZCBjYW4gdGFrZSBhbGwgdGhl IHJlc291cmNlcyBvbiBvdXIgY2x1c3Rlci4NCg0KV2Ugd2FudCBhIGNvbmZpZ3VyYXRpb24gd2hl cmUgdGhlIHF1aWNrIGpvYnMgZ2V0IHJlc291cmNlcyBhbmQgbm90IGdldCBibG9ja2VkIGJ5IHRo ZSBsb25nIHJ1bm5pbmcgam9icy4gIFdlIGFyZSB1c2luZyB0aGUgRmFpciBzY2hlZHVsZXIgd2l0 aCB0aGUgbG9uZyBqb2JzIGluIG9uZSBxdWV1ZSBhbmQgdGhlIHNob3J0IGpvYnMgaW4gYW5vdGhl ciBxdWV1ZS4NCg0KU2VlbXMgcHJlZW1wdGlvbiB3aXRoIG1pblJlc291cmNlcyBpcyB0aGUgb25s eSB3YXkgdG8gaGF2ZSB0aGUgcXVpY2sgcnVubmluZyBqb2JzIGdldCBjbHVzdGVyIHRpbWUuICBC dXQgbm90IG9ubHkgZG8gdGhleSBwcmVlbXB0IHRhc2tzIHRoYXQgaGF2ZSBiZWVuIHJ1bm5pbmcg Zm9yIGEgd2hpbGUgKGdyaXBlOiB0aGUgcHJlZW1wdG9yIGRvZXMgbm90IHNlZW0gdG8ga2lsbCB0 aGUgam9icyB0aGF0IGhhdmUgYmVlbiBydW5uaW5nIHRoZSBzaG9ydGVzdCksIGJ1dCBpZiB0aGV5 IHByZWVtcHQgYSByZWR1Y2VyIHRoZW4gbWFwcGVycyBuZWVkIHRvIGJlIHJlcnVuIGFzIHRoZSBk YXRhIGlzIGxvc3QgYW5kIHRoZSByZWR1Y2VycyB3YWl0LCB3YXN0aW5nIHJlc291cmNlcyBhbmQg Y2F1c2luZyBtb3JlIHByZWVtcHRpb24uICBUaGlzIGNyZWF0ZXMgYSBuYXN0eSBjeWNsZSBhbmQg dGhlIGpvYiBuZXZlciBmaW5pc2hlcy4NCg0KSSBhbSBsb29raW5nIGZvciBzdWdnZXN0aW9uIG9u IGhvdyB0byBtYWtlIHRoaXMgd29yay4gICBJcyB0aGVyZSBhIHdheSB0byBoYXZlIHRoZSBtYXBw ZXJzIG5vdCBkZWxldGUgdGhlIGludGVybWVkaWF0ZSBkYXRhIHVudGlsIHRoZSBqb2IgZmluaXNo ZXM/ICBJcyB0aGVyZSBhIHdheSB0byBoYXZlIHRoZSBwcmVlbXB0ZXIga2lsbCB0aGUgc2hvcnRl ZCBydW5uaW5nIGpvYnM/ICBPciBhbSBJIGFwcHJvYWNoaW5nIHRoaXMgZW50aXJlbHkgd3Jvbmc/ DQoNClRoYW5rcyBpbiBhZHZhbmNlIGZvciBhbnkgYW5kIGFsbCBhZHZpY2UuDQoNCkNoZWVycywN Cg0KUmFuZHkNCg0KUFM6IEdldHRpbmcgYSBsYXJnZXIgY2x1c3RlciBpcyBub3QgYW4gb3B0aW9u Lg0K --_000_D7082A9589A14118AA58848E9834E436connexitycom_ Content-Type: text/html; charset="utf-8" Content-ID: <752CCA72D51F9E4BB9590A63FFD67FDA@namprd02.prod.outlook.com> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsgY29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zaXplOiAx NHB4OyBmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbicsIHNhbnMtc2VyaWY7Ij4NCjxkaXY+ V2UgaGF2ZSBhIGNsdXN0ZXIgd2hlcmUgd2UgaGF2ZSBib3RoIHF1aWNrIGFuZCBsb25nIHJ1bm5p bmcgam9icy4gJm5ic3A7VGhlIGxvbmcgcnVubmluZyBqb2JzIGFyZSBtYXBwZXJzIHRoYXQgdGFr ZSAxJiM0MzsgaG91cnMgYW5kIHJlZHVjZXJzIHRoYXQgdGFrZSAxJiM0Mztob3VycyBhbmQgY2Fu IHRha2UgYWxsIHRoZSByZXNvdXJjZXMgb24gb3VyIGNsdXN0ZXIuPC9kaXY+DQo8ZGl2Pjxicj4N CjwvZGl2Pg0KPGRpdj5XZSB3YW50IGEgY29uZmlndXJhdGlvbiB3aGVyZSB0aGUgcXVpY2sgam9i cyBnZXQgcmVzb3VyY2VzIGFuZCBub3QgZ2V0IGJsb2NrZWQgYnkgdGhlIGxvbmcgcnVubmluZyBq b2JzLiAmbmJzcDtXZSBhcmUgdXNpbmcgdGhlIEZhaXIgc2NoZWR1bGVyIHdpdGggdGhlIGxvbmcg am9icyBpbiBvbmUgcXVldWUgYW5kIHRoZSBzaG9ydCBqb2JzIGluIGFub3RoZXIgcXVldWUuICZu YnNwOzwvZGl2Pg0KPGRpdj48YnI+DQo8L2Rpdj4NCjxkaXY+U2VlbXMgcHJlZW1wdGlvbiB3aXRo IG1pblJlc291cmNlcyBpcyB0aGUgb25seSB3YXkgdG8gaGF2ZSB0aGUgcXVpY2sgcnVubmluZyBq b2JzIGdldCBjbHVzdGVyIHRpbWUuICZuYnNwO0J1dCBub3Qgb25seSBkbyB0aGV5IHByZWVtcHQg dGFza3MgdGhhdCBoYXZlIGJlZW4gcnVubmluZyBmb3IgYSB3aGlsZSAoZ3JpcGU6IHRoZSBwcmVl bXB0b3IgZG9lcyBub3Qgc2VlbSB0byBraWxsIHRoZSBqb2JzIHRoYXQgaGF2ZSBiZWVuIHJ1bm5p bmcgdGhlIHNob3J0ZXN0KSwNCiBidXQgaWYgdGhleSBwcmVlbXB0IGEgcmVkdWNlciB0aGVuIG1h cHBlcnMgbmVlZCB0byBiZSByZXJ1biBhcyB0aGUgZGF0YSBpcyBsb3N0IGFuZCB0aGUgcmVkdWNl cnMgd2FpdCwgd2FzdGluZyByZXNvdXJjZXMgYW5kIGNhdXNpbmcgbW9yZSBwcmVlbXB0aW9uLiAm bmJzcDtUaGlzIGNyZWF0ZXMgYSBuYXN0eSBjeWNsZSBhbmQgdGhlIGpvYiBuZXZlciBmaW5pc2hl cy48L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2PkkgYW0gbG9va2luZyBmb3Igc3VnZ2Vz dGlvbiBvbiBob3cgdG8gbWFrZSB0aGlzIHdvcmsuICZuYnNwOyBJcyB0aGVyZSBhIHdheSB0byBo YXZlIHRoZSBtYXBwZXJzIG5vdCBkZWxldGUgdGhlIGludGVybWVkaWF0ZSBkYXRhIHVudGlsIHRo ZSBqb2IgZmluaXNoZXM/ICZuYnNwO0lzIHRoZXJlIGEgd2F5IHRvIGhhdmUgdGhlIHByZWVtcHRl ciBraWxsIHRoZSBzaG9ydGVkIHJ1bm5pbmcgam9icz8gJm5ic3A7T3IgYW0gSSBhcHByb2FjaGlu ZyB0aGlzIGVudGlyZWx5DQogd3Jvbmc/PC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPGRpdj5U aGFua3MgaW4gYWR2YW5jZSBmb3IgYW55IGFuZCBhbGwgYWR2aWNlLiAmbmJzcDs8L2Rpdj4NCjxk aXY+PGJyPg0KPC9kaXY+DQo8ZGl2PkNoZWVycyw8L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8 ZGl2PlJhbmR5PC9kaXY+DQo8YnI+DQo8ZGl2PlBTOiBHZXR0aW5nIGEgbGFyZ2VyIGNsdXN0ZXIg aXMgbm90IGFuIG9wdGlvbi48L2Rpdj4NCjwvYm9keT4NCjwvaHRtbD4NCg== --_000_D7082A9589A14118AA58848E9834E436connexitycom_--