From dev-return-2547-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Thu Mar 29 16:30:09 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id E1A44180645 for ; Thu, 29 Mar 2018 16:30:08 +0200 (CEST) Received: (qmail 88791 invoked by uid 500); 29 Mar 2018 14:30:07 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Delivered-To: moderator for dev@mxnet.incubator.apache.org Received: (qmail 30947 invoked by uid 99); 27 Mar 2018 08:30:30 -0000 X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.011 X-Spam-Level: X-Spam-Status: No, score=-3.011 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.48,366,1517904000"; d="scan'208,217";a="29197607" From: "Ye, Zhouhai" To: 'Nan Zhu' , "'dev@mxnet.incubator.apache.org'" CC: "'Li, Mu'" , "Lv, Tao A" , "Ma, Guokai" , 'Rahul Huilgol' , "Ye, Jason Y" , "Zhang, Rong A" , "Zhao, Patric" Subject: RE: Extend MXNET distributed training with MPI AllReduce Thread-Topic: Extend MXNET distributed training with MPI AllReduce Thread-Index: AdPFZAySH5SbQXjISb+3Z1rT3x8ezf//lhCAgAAFKAD//3Ps8P/+4n/g//1u/5A= Date: Tue, 27 Mar 2018 08:30:13 +0000 Message-ID: <6FBCF67CCE13184F8B65E322BB7D48ED316D791B@SHSMSX104.ccr.corp.intel.com> References: <6FBCF67CCE13184F8B65E322BB7D48ED316D77BD@SHSMSX104.ccr.corp.intel.com> In-Reply-To: <6FBCF67CCE13184F8B65E322BB7D48ED316D77BD@SHSMSX104.ccr.corp.intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiNzVlYmQzYTEtYTA4Yy00YTVhLTgyODYtMzdkMjZiNWU1OTYyIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE2LjUuOS4zIiwiVHJ1c3RlZExhYmVsSGFzaCI6IjJkbkhqbnNhTExacW1rQWQ5Rm9rSlNSQ2o4MXdTcHQrRTJnblkyV1hlYUk9In0= x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.0.116 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: multipart/alternative; boundary="_000_6FBCF67CCE13184F8B65E322BB7D48ED316D791BSHSMSX104ccrcor_" MIME-Version: 1.0 --_000_6FBCF67CCE13184F8B65E322BB7D48ED316D791BSHSMSX104ccrcor_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Rm9yIG91ciBjdXJyZW50IFBPQzoNCmIuIEFkZCBtcGkua3ZzdG9yZSBpbiBweXRob24uIEl0IGRl cGVuZHMgdXBvbiBteG5ldCBzdWJtb2R1bGUgbXBpX2NvbGxlY3RpdmVzIChuZXcpLiAobXBpX2Nv bGxlY3RpdmVzIGlzIGMrKyBsaWJyYXJ5IGRlcGVuZGluZyB1cG9uIG14bmV0LikgICAgKEFkZCBu ZXcgdHlwZSBvZiBrdnN0b3JlIGluIHB5dGhvbiBsYXllci4pDQoNCm1waV9jb2xsZWN0aXZlcyBk b2VzbuKAmXQgbmVlZCB0byBiZSBhIHNpbmdsZSBjKysgbGlicmFyeS4gSXTigJlzIHNvdXJjZSBj b2RlIGNhbiBiZSBjb21waWxlZCBpbnRvIGxpYm14bmV0LnNvLg0KDQoNCkZyb206IFllLCBaaG91 aGFpDQpTZW50OiBUdWVzZGF5LCBNYXJjaCAyNywgMjAxOCAxMToyMSBBTQ0KVG86IE5hbiBaaHUg PHpodW5hbm1jZ2lsbEBnbWFpbC5jb20+OyBkZXZAbXhuZXQuaW5jdWJhdG9yLmFwYWNoZS5vcmcN CkNjOiBMaSwgTXUgPG1saUBhbWF6b24uY29tPjsgTHYsIFRhbyBBIDx0YW8uYS5sdkBpbnRlbC5j b20+OyBNYSwgR3Vva2FpIDxndW9rYWkubWFAaW50ZWwuY29tPjsgUmFodWwgSHVpbGdvbCA8cmFo dWxodWlsZ29sQGdtYWlsLmNvbT47IFllLCBKYXNvbiBZIDxqYXNvbi55LnllQGludGVsLmNvbT47 IFpoYW5nLCBSb25nIEEgPHJvbmcuYS56aGFuZ0BpbnRlbC5jb20+OyBaaGFvLCBQYXRyaWMgPHBh dHJpYy56aGFvQGludGVsLmNvbT4NClN1YmplY3Q6IFJFOiBFeHRlbmQgTVhORVQgZGlzdHJpYnV0 ZWQgdHJhaW5pbmcgd2l0aCBNUEkgQWxsUmVkdWNlDQoNCllvdSBjYW4gY2hlY2sgbXBpLmt2c3Rv cmUgQVBJIFNwZWMgaW4gb3VyIGRlc2lnbiBkb2M6DQoNCmUuZy4gIFdlIGFkZCBwdXNocHVsbCBh bmQgYnJvYWRjYXN0IGludGVyZmFjZSBhbmQgZGlzYWJsZSBvcmlnaW5hbCBwdXNoIGFuZCBwdWxs IGluIG5ldyBrdnN0b3JlLg0KDQpGcm9tOiBZZSwgWmhvdWhhaQ0KU2VudDogVHVlc2RheSwgTWFy Y2ggMjcsIDIwMTggMTE6MTggQU0NClRvOiAnTmFuIFpodScgPHpodW5hbm1jZ2lsbEBnbWFpbC5j b208bWFpbHRvOnpodW5hbm1jZ2lsbEBnbWFpbC5jb20+PjsgZGV2QG14bmV0LmluY3ViYXRvci5h cGFjaGUub3JnPG1haWx0bzpkZXZAbXhuZXQuaW5jdWJhdG9yLmFwYWNoZS5vcmc+DQpDYzogTGks IE11IDxtbGlAYW1hem9uLmNvbTxtYWlsdG86bWxpQGFtYXpvbi5jb20+PjsgTHYsIFRhbyBBIDx0 YW8uYS5sdkBpbnRlbC5jb208bWFpbHRvOnRhby5hLmx2QGludGVsLmNvbT4+OyBNYSwgR3Vva2Fp IDxndW9rYWkubWFAaW50ZWwuY29tPG1haWx0bzpndW9rYWkubWFAaW50ZWwuY29tPj47IFJhaHVs IEh1aWxnb2wgPHJhaHVsaHVpbGdvbEBnbWFpbC5jb208bWFpbHRvOnJhaHVsaHVpbGdvbEBnbWFp bC5jb20+PjsgWWUsIEphc29uIFkgPGphc29uLnkueWVAaW50ZWwuY29tPG1haWx0bzpqYXNvbi55 LnllQGludGVsLmNvbT4+OyBaaGFuZywgUm9uZyBBIDxyb25nLmEuemhhbmdAaW50ZWwuY29tPG1h aWx0bzpyb25nLmEuemhhbmdAaW50ZWwuY29tPj47IFpoYW8sIFBhdHJpYyA8cGF0cmljLnpoYW9A aW50ZWwuY29tPG1haWx0bzpwYXRyaWMuemhhb0BpbnRlbC5jb20+Pg0KU3ViamVjdDogUkU6IEV4 dGVuZCBNWE5FVCBkaXN0cmlidXRlZCB0cmFpbmluZyB3aXRoIE1QSSBBbGxSZWR1Y2UNCg0KSGks DQpOYW4gWmh1DQoNCkFzIHdlIGRlc2NyaWJlZCBpbiBvdXIgZGVzaWduIGRvYywgdGhlcmXigJlz IHR3byBwb3NzaWJsZSBjb2RlIHN0cnVjdHVyZSAoaW1wbGVtZW50YXRpb24pIDogKGN1cnJlbnRs eSB3ZSBpbXBsZW1lbnQgc2Vjb25kIGluIG91ciBQT0MpDQoNCg0KYS4gICAgICBJbXBsZW1lbnQg bXBpLmt2c3RvcmUgc2FtZSBsZXZlbCBhcyB0aGUgY3VycmVudCBrdnN0b3JlcyAoQ1BQIHNyYy9r dnN0b3JlKSAgIChBZGhlcmUgdG8gb3JpZ2luYWwga3ZzdG9yZSBmYWN0b3J5IHBhdHRlcm4pDQoN Cg0KDQpiLiAgICAgIEFkZCBtcGkua3ZzdG9yZSBpbiBweXRob24uIEl0IGRlcGVuZHMgdXBvbiBt eG5ldCBzdWJtb2R1bGUgbXBpX2NvbGxlY3RpdmVzIChuZXcpLiAobXBpX2NvbGxlY3RpdmVzIGlz IGMrKyBsaWJyYXJ5IGRlcGVuZGluZyB1cG9uIG14bmV0LikgICAgKEFkZCBuZXcgdHlwZSBvZiBr dnN0b3JlIGluIHB5dGhvbiBsYXllci4pDQoNCg0KRm9yIHlvdXIgc2Vjb25kIHF1ZXN0aW9uLCBJ IHRoaW5rIHRvIG1ha2UgYSBzaW5nbGUgY29tbXVuaWNhdGlvbiBzdWJtb2R1bGUgaXMgT0sgKGp1 c3QgbGlrZSBhLikuIEJ1dCBhbiB1bmlmaWVkIGFic3RyYWN0aW9uIGZvciBib3RoIFBTIGFuZCBB bGxyZWR1Y2UgaXMgdmVyeSBoYXJkLg0KDQoNCkZyb206IE5hbiBaaHUgW21haWx0bzp6aHVuYW5t Y2dpbGxAZ21haWwuY29tXQ0KU2VudDogVHVlc2RheSwgTWFyY2ggMjcsIDIwMTggMTA6MzkgQU0N ClRvOiBkZXZAbXhuZXQuaW5jdWJhdG9yLmFwYWNoZS5vcmc8bWFpbHRvOmRldkBteG5ldC5pbmN1 YmF0b3IuYXBhY2hlLm9yZz4NCkNjOiBMaSwgTXUgPG1saUBhbWF6b24uY29tPG1haWx0bzptbGlA YW1hem9uLmNvbT4+OyBMdiwgVGFvIEEgPHRhby5hLmx2QGludGVsLmNvbTxtYWlsdG86dGFvLmEu bHZAaW50ZWwuY29tPj47IE1hLCBHdW9rYWkgPGd1b2thaS5tYUBpbnRlbC5jb208bWFpbHRvOmd1 b2thaS5tYUBpbnRlbC5jb20+PjsgUmFodWwgSHVpbGdvbCA8cmFodWxodWlsZ29sQGdtYWlsLmNv bTxtYWlsdG86cmFodWxodWlsZ29sQGdtYWlsLmNvbT4+OyBZZSwgSmFzb24gWSA8amFzb24ueS55 ZUBpbnRlbC5jb208bWFpbHRvOmphc29uLnkueWVAaW50ZWwuY29tPj47IFllLCBaaG91aGFpIDx6 aG91aGFpLnllQGludGVsLmNvbTxtYWlsdG86emhvdWhhaS55ZUBpbnRlbC5jb20+PjsgWmhhbmcs IFJvbmcgQSA8cm9uZy5hLnpoYW5nQGludGVsLmNvbTxtYWlsdG86cm9uZy5hLnpoYW5nQGludGVs LmNvbT4+OyBaaGFvLCBQYXRyaWMgPHBhdHJpYy56aGFvQGludGVsLmNvbTxtYWlsdG86cGF0cmlj LnpoYW9AaW50ZWwuY29tPj4NClN1YmplY3Q6IFJlOiBFeHRlbmQgTVhORVQgZGlzdHJpYnV0ZWQg dHJhaW5pbmcgd2l0aCBNUEkgQWxsUmVkdWNlDQoNCkhpLCBQYXRyaWMNCg0KSXQncyBwcmV0dHkg bmljZSB3b3JrIQ0KDQpBIHF1ZXN0aW9uOg0KDQpob3cgdGhlIGZ1dHVyZSBjb2RlIHN0cnVjdHVy ZSB3b3VsZCBsb29rIGxpa2Ugd2hlbiBwdXR0aW5nIHRoaXMgYWxscmVkdWNlIG1vZHVsZSBhcyBh biBzdWJtb2R1bGU/IFdlIHdpbGwgaGF2ZSB0d28gY29tbXVuaWNhdGlvbiBzdWJtb2R1bGVzPw0K DQpJcyB0aGVyZSBhbnkgcGxhbiB0byBnaXZlIGFuIHVuaWZpZWQgYWJzdHJhY3Rpb24gZm9yIGNv bW11bmljYXRpb24gc28gdGhhdCBhIHNpbmdsZSBjb21tdW5pY2F0aW9uIHN1Ym1vZHVsZSBpcyBw b3NzaWJsZT8NCg0KQmVzdCwNCg0KTmFuDQoNCg0KT24gTW9uLCBNYXIgMjYsIDIwMTggYXQgNzoy MCBQTSwgQ2hyaXMgT2xpdmllciA8Y2pvbGl2aWVyMDFAZ21haWwuY29tPG1haWx0bzpjam9saXZp ZXIwMUBnbWFpbC5jb20+PiB3cm90ZToNCmdyZWF0ISBuaWNlIHdvcmshDQoNCk9uIE1vbiwgTWFy IDI2LCAyMDE4IGF0IDY6MzEgUE0gWmhhbywgUGF0cmljIDxwYXRyaWMuemhhb0BpbnRlbC5jb208 bWFpbHRvOnBhdHJpYy56aGFvQGludGVsLmNvbT4+IHdyb3RlOg0KDQo+IEhpIE1YTkVUIG93bmVy cy9kZXZlbG9wZXJzLA0KPg0KPiBBcyB5b3Uga25vd24sIHRoZSBBbGxSZWR1Y2UgYW5kIFBhcmFt ZXRlciBTZXZlcnMgYXJlIHR3byB2ZXJ5IHBvcHVsYXINCj4gZGlzdHJpYnV0ZWQgdHJhaW5pbmcg bW9kZXMgaW4gREwuDQo+DQo+IEN1cnJlbnRseSwgTVhORVQgb25seSBzdXBwb3J0cyBwYXJhbWV0 ZXIgc2VydmVyIG1vZGUgYW5kIGlzIGxhY2sgb2YNCj4gQWxsUmVkdWNlIG1vZGUuIE90aGVyIGZy YW1ld29ya3MsIGxpa2UgdGVuc29yZmxvdywgcHl0b3JjaCwgY2FmZmUsIGV0YywgY2FuDQo+IHdv cmsgd2l0aCBBbGxSZWR1Y2UuDQo+IEJhc2VkIG9uIG91ciBhbmFseXNpcyBhbmQgZXhwZXJpbWVu dHMsIEFsbFJlZHVjZSBtb2RlIGNhbiBhY2hpZXZlcyB0aGUNCj4gYmV0dGVyIHNjYWxhYmlsaXR5 IGFuZCBtb3JlIGVmZmljaWVuY3kNCj4NCj4gU28sIHdlIHByb3Bvc2UgdG8gZXh0ZW5kIE1YTkVU IGRpc3RyaWJ1dGVkIHRyYWluaW5nIHdpdGggTVBJIEFsbFJlZHVjZQ0KPiBtb2RlLg0KPiBXZSBo YXZlIGltcGxlbWVudGVkIGEgQWxsUmVkdWNlIHByb3RvdHlwZSBpbiBNWE5FVCBhbmQgdGhlIHJl c3VsdHMgYXJlDQo+IHZlcnkgcG9zaXRpdmUuDQo+IEFsbFJlZHVjZSBtb2RlIGNhbiBnZXQgOTQu NyUgc2NhbGUgZWZmaWNpZW5jeSBieSA4IGNvbXB1dGUgbm9kZXMgZm9yIFZHRzE2DQo+IHdoaWxl IHRoZSBQYXJhbWV0ZXIgU2VydmVyIHJlcXVpcmVzIHRvdGFsbHkgMTYgbm9kZXMgKDggY29tcHV0 ZSBub2RlcyArIDgNCj4gcGFyYW1ldGVyIHNldmVycykgdG8gcmVhY2ggOTMuMiUuDQo+DQo+IFRo ZSB3aG9sZSBwcm9wb3NhbCBpcyBhdmFpbGFibGUgaW4gTVhORVQgd2lraS4gQW55IGZlZWRiYWNr IGFyZSBoaWdobHkNCj4gYXBwcmVjaWF0ZWQuDQo+DQo+IGh0dHBzOi8vY3dpa2kuYXBhY2hlLm9y Zy9jb25mbHVlbmNlL2Rpc3BsYXkvTVhORVQvRXh0ZW5kK01YTmV0K0Rpc3RyaWJ1dGVkK1RyYWlu aW5nK2J5K01QSStBbGxSZWR1Y2UNCj4NCj4gVGhhbmtzIGluIGFkdmFuY2UuDQo+DQo+IEJSLA0K Pg0KPiAtLVBhdHJpYw0KPg0KPg0KDQo= --_000_6FBCF67CCE13184F8B65E322BB7D48ED316D791BSHSMSX104ccrcor_--