From dev-return-2545-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Thu Mar 29 16:29:41 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id F1041180645 for ; Thu, 29 Mar 2018 16:29:40 +0200 (CEST) Received: (qmail 87544 invoked by uid 500); 29 Mar 2018 14:29:40 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Delivered-To: moderator for dev@mxnet.incubator.apache.org Received: (qmail 86004 invoked by uid 99); 27 Mar 2018 03:18:35 -0000 X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.311 X-Spam-Level: X-Spam-Status: No, score=-0.311 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.48,366,1517904000"; d="scan'208,217";a="31574001" From: "Ye, Zhouhai" To: Nan Zhu , "dev@mxnet.incubator.apache.org" CC: "Li, Mu" , "Lv, Tao A" , "Ma, Guokai" , Rahul Huilgol , "Ye, Jason Y" , "Zhang, Rong A" , "Zhao, Patric" Subject: RE: Extend MXNET distributed training with MPI AllReduce Thread-Topic: Extend MXNET distributed training with MPI AllReduce Thread-Index: AdPFZAySH5SbQXjISb+3Z1rT3x8ezf//lhCAgAAFKAD//3Ps8A== Date: Tue, 27 Mar 2018 03:18:19 +0000 Message-ID: <6FBCF67CCE13184F8B65E322BB7D48ED316D77A0@SHSMSX104.ccr.corp.intel.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiNzVlYmQzYTEtYTA4Yy00YTVhLTgyODYtMzdkMjZiNWU1OTYyIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE2LjUuOS4zIiwiVHJ1c3RlZExhYmVsSGFzaCI6IjJkbkhqbnNhTExacW1rQWQ5Rm9rSlNSQ2o4MXdTcHQrRTJnblkyV1hlYUk9In0= x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.0.116 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: multipart/alternative; boundary="_000_6FBCF67CCE13184F8B65E322BB7D48ED316D77A0SHSMSX104ccrcor_" MIME-Version: 1.0 --_000_6FBCF67CCE13184F8B65E322BB7D48ED316D77A0SHSMSX104ccrcor_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGksDQpOYW4gWmh1DQoNCkFzIHdlIGRlc2NyaWJlZCBpbiBvdXIgZGVzaWduIGRvYywgdGhlcmXi gJlzIHR3byBwb3NzaWJsZSBjb2RlIHN0cnVjdHVyZSAoaW1wbGVtZW50YXRpb24pIDogKGN1cnJl bnRseSB3ZSBpbXBsZW1lbnQgc2Vjb25kIGluIG91ciBQT0MpDQoNCg0KYS4gICAgICBJbXBsZW1l bnQgbXBpLmt2c3RvcmUgc2FtZSBsZXZlbCBhcyB0aGUgY3VycmVudCBrdnN0b3JlcyAoQ1BQIHNy Yy9rdnN0b3JlKSAgIChBZGhlcmUgdG8gb3JpZ2luYWwga3ZzdG9yZSBmYWN0b3J5IHBhdHRlcm4p DQoNCg0KDQpiLiAgICAgIEFkZCBtcGkua3ZzdG9yZSBpbiBweXRob24uIEl0IGRlcGVuZHMgdXBv biBteG5ldCBzdWJtb2R1bGUgbXBpX2NvbGxlY3RpdmVzIChuZXcpLiAobXBpX2NvbGxlY3RpdmVz IGlzIGMrKyBsaWJyYXJ5IGRlcGVuZGluZyB1cG9uIG14bmV0LikgICAgKEFkZCBuZXcgdHlwZSBv ZiBrdnN0b3JlIGluIHB5dGhvbiBsYXllci4pDQoNCg0KRm9yIHlvdXIgc2Vjb25kIHF1ZXN0aW9u LCBJIHRoaW5rIHRvIG1ha2UgYSBzaW5nbGUgY29tbXVuaWNhdGlvbiBzdWJtb2R1bGUgaXMgT0sg KGp1c3QgbGlrZSBhLikuIEJ1dCBhbiB1bmlmaWVkIGFic3RyYWN0aW9uIGZvciBib3RoIFBTIGFu ZCBBbGxyZWR1Y2UgaXMgdmVyeSBoYXJkLg0KDQoNCkZyb206IE5hbiBaaHUgW21haWx0bzp6aHVu YW5tY2dpbGxAZ21haWwuY29tXQ0KU2VudDogVHVlc2RheSwgTWFyY2ggMjcsIDIwMTggMTA6Mzkg QU0NClRvOiBkZXZAbXhuZXQuaW5jdWJhdG9yLmFwYWNoZS5vcmcNCkNjOiBMaSwgTXUgPG1saUBh bWF6b24uY29tPjsgTHYsIFRhbyBBIDx0YW8uYS5sdkBpbnRlbC5jb20+OyBNYSwgR3Vva2FpIDxn dW9rYWkubWFAaW50ZWwuY29tPjsgUmFodWwgSHVpbGdvbCA8cmFodWxodWlsZ29sQGdtYWlsLmNv bT47IFllLCBKYXNvbiBZIDxqYXNvbi55LnllQGludGVsLmNvbT47IFllLCBaaG91aGFpIDx6aG91 aGFpLnllQGludGVsLmNvbT47IFpoYW5nLCBSb25nIEEgPHJvbmcuYS56aGFuZ0BpbnRlbC5jb20+ OyBaaGFvLCBQYXRyaWMgPHBhdHJpYy56aGFvQGludGVsLmNvbT4NClN1YmplY3Q6IFJlOiBFeHRl bmQgTVhORVQgZGlzdHJpYnV0ZWQgdHJhaW5pbmcgd2l0aCBNUEkgQWxsUmVkdWNlDQoNCkhpLCBQ YXRyaWMNCg0KSXQncyBwcmV0dHkgbmljZSB3b3JrIQ0KDQpBIHF1ZXN0aW9uOg0KDQpob3cgdGhl IGZ1dHVyZSBjb2RlIHN0cnVjdHVyZSB3b3VsZCBsb29rIGxpa2Ugd2hlbiBwdXR0aW5nIHRoaXMg YWxscmVkdWNlIG1vZHVsZSBhcyBhbiBzdWJtb2R1bGU/IFdlIHdpbGwgaGF2ZSB0d28gY29tbXVu aWNhdGlvbiBzdWJtb2R1bGVzPw0KDQpJcyB0aGVyZSBhbnkgcGxhbiB0byBnaXZlIGFuIHVuaWZp ZWQgYWJzdHJhY3Rpb24gZm9yIGNvbW11bmljYXRpb24gc28gdGhhdCBhIHNpbmdsZSBjb21tdW5p Y2F0aW9uIHN1Ym1vZHVsZSBpcyBwb3NzaWJsZT8NCg0KQmVzdCwNCg0KTmFuDQoNCg0KT24gTW9u LCBNYXIgMjYsIDIwMTggYXQgNzoyMCBQTSwgQ2hyaXMgT2xpdmllciA8Y2pvbGl2aWVyMDFAZ21h aWwuY29tPG1haWx0bzpjam9saXZpZXIwMUBnbWFpbC5jb20+PiB3cm90ZToNCmdyZWF0ISBuaWNl IHdvcmshDQoNCk9uIE1vbiwgTWFyIDI2LCAyMDE4IGF0IDY6MzEgUE0gWmhhbywgUGF0cmljIDxw YXRyaWMuemhhb0BpbnRlbC5jb208bWFpbHRvOnBhdHJpYy56aGFvQGludGVsLmNvbT4+IHdyb3Rl Og0KDQo+IEhpIE1YTkVUIG93bmVycy9kZXZlbG9wZXJzLA0KPg0KPiBBcyB5b3Uga25vd24sIHRo ZSBBbGxSZWR1Y2UgYW5kIFBhcmFtZXRlciBTZXZlcnMgYXJlIHR3byB2ZXJ5IHBvcHVsYXINCj4g ZGlzdHJpYnV0ZWQgdHJhaW5pbmcgbW9kZXMgaW4gREwuDQo+DQo+IEN1cnJlbnRseSwgTVhORVQg b25seSBzdXBwb3J0cyBwYXJhbWV0ZXIgc2VydmVyIG1vZGUgYW5kIGlzIGxhY2sgb2YNCj4gQWxs UmVkdWNlIG1vZGUuIE90aGVyIGZyYW1ld29ya3MsIGxpa2UgdGVuc29yZmxvdywgcHl0b3JjaCwg Y2FmZmUsIGV0YywgY2FuDQo+IHdvcmsgd2l0aCBBbGxSZWR1Y2UuDQo+IEJhc2VkIG9uIG91ciBh bmFseXNpcyBhbmQgZXhwZXJpbWVudHMsIEFsbFJlZHVjZSBtb2RlIGNhbiBhY2hpZXZlcyB0aGUN Cj4gYmV0dGVyIHNjYWxhYmlsaXR5IGFuZCBtb3JlIGVmZmljaWVuY3kNCj4NCj4gU28sIHdlIHBy b3Bvc2UgdG8gZXh0ZW5kIE1YTkVUIGRpc3RyaWJ1dGVkIHRyYWluaW5nIHdpdGggTVBJIEFsbFJl ZHVjZQ0KPiBtb2RlLg0KPiBXZSBoYXZlIGltcGxlbWVudGVkIGEgQWxsUmVkdWNlIHByb3RvdHlw ZSBpbiBNWE5FVCBhbmQgdGhlIHJlc3VsdHMgYXJlDQo+IHZlcnkgcG9zaXRpdmUuDQo+IEFsbFJl ZHVjZSBtb2RlIGNhbiBnZXQgOTQuNyUgc2NhbGUgZWZmaWNpZW5jeSBieSA4IGNvbXB1dGUgbm9k ZXMgZm9yIFZHRzE2DQo+IHdoaWxlIHRoZSBQYXJhbWV0ZXIgU2VydmVyIHJlcXVpcmVzIHRvdGFs bHkgMTYgbm9kZXMgKDggY29tcHV0ZSBub2RlcyArIDgNCj4gcGFyYW1ldGVyIHNldmVycykgdG8g cmVhY2ggOTMuMiUuDQo+DQo+IFRoZSB3aG9sZSBwcm9wb3NhbCBpcyBhdmFpbGFibGUgaW4gTVhO RVQgd2lraS4gQW55IGZlZWRiYWNrIGFyZSBoaWdobHkNCj4gYXBwcmVjaWF0ZWQuDQo+DQo+IGh0 dHBzOi8vY3dpa2kuYXBhY2hlLm9yZy9jb25mbHVlbmNlL2Rpc3BsYXkvTVhORVQvRXh0ZW5kK01Y TmV0K0Rpc3RyaWJ1dGVkK1RyYWluaW5nK2J5K01QSStBbGxSZWR1Y2UNCj4NCj4gVGhhbmtzIGlu IGFkdmFuY2UuDQo+DQo+IEJSLA0KPg0KPiAtLVBhdHJpYw0KPg0KPg0KDQo= --_000_6FBCF67CCE13184F8B65E322BB7D48ED316D77A0SHSMSX104ccrcor_--