From dev-return-2468-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Wed Mar 14 14:09:37 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 47E39180654 for ; Wed, 14 Mar 2018 14:09:36 +0100 (CET) Received: (qmail 22097 invoked by uid 500); 14 Mar 2018 13:09:35 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 22080 invoked by uid 99); 14 Mar 2018 13:09:34 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 Mar 2018 13:09:34 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 35D0EC5F96 for ; Wed, 14 Mar 2018 13:09:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id UUVEY78kbkK8 for ; Wed, 14 Mar 2018 13:09:28 +0000 (UTC) Received: from mail-lf0-f50.google.com (mail-lf0-f50.google.com [209.85.215.50]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C13795F178 for ; Wed, 14 Mar 2018 13:09:27 +0000 (UTC) Received: by mail-lf0-f50.google.com with SMTP id m69-v6so4675718lfe.8 for ; Wed, 14 Mar 2018 06:09:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=GyVrHd2ywLT7lVAUS7XazLFsfMo4MBFi6alIGp/czaY=; b=sByz7FclG/PBY6NNasIjpx8KVlvLMnS6YI7GRzUMm+KoJGBKGQKH4LaDCntRsUhHEb pUi0OHA64Iam2lCfV3rCvuElCAHYmNtOvhUEC3b/cWfvrCkq1GZv+wYxPCBLUrGXp+XG mTzFu98MUrmZcdrDxMiyThxY+cjc5e16vg8PlW6ZYa36Pg8uRUuiwCdOBnIORH03Q3eH AwUJMvF5yVeFaqeKDfZT+LGdjIWQ2HKNsjN7/I8uOt8+0p8BVfQKLmxRtGjGvQ6lYHQV cGrHta1ZNBEYKNVfRliFY0/9LRTzFitTLbQYT7MK9ok+aquwtxjd6Ya0ppVDvGI/hLog 988g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=GyVrHd2ywLT7lVAUS7XazLFsfMo4MBFi6alIGp/czaY=; b=AlUyUEIRP8BSQYPDFM1AtxEeYUfbdNFfVzeUFcEu2PBynRqw/WzhMx2q3zA3PbBP7R xc8KAkHNrwYggO7DYcme2jyLSQGjyZDjifdBtqkzPIQX2d5SMiCguyyCnMPusg5RA9QY a0/zzH3Us+3sDjTc8pYZdTYQvf2lmRSvl+3bSQtHXYbFxswc2+kDGotdlgQMNa5UJUKH NgHcjKWgxJFmx7+3/9EX8L/6bTm1SIL5Kbgpzwl6ll7VJeDb7jHzeMO6JysIQIQ2izSX guXeicy6kqJ6Tanc6Nof1WmTOsHRv94MZiPeypmAlSKd2FMjeeF4tlXoh7c1IOUbjFWW Gh0g== X-Gm-Message-State: AElRT7H4NRZfwfXQ2iLT2KdRe8emrQtGfN123SVkt7NU8NhIzNsrFi0N 43zNkCuqtcOdrmM2sx1+mJ4LFi+1MysdU4Cg/GfvUA== X-Google-Smtp-Source: AG47ELvwBOjtrQDKeXPgbhXFB37gXKr3VwqY1duiX90+Jq+bBIXDQYdcFqeUzkI5emsqss/1enoVQbf0UJ7Y4ah8jdU= X-Received: by 10.46.144.7 with SMTP id h7mr3185937ljg.37.1521032966820; Wed, 14 Mar 2018 06:09:26 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a19:a281:0:0:0:0:0 with HTTP; Wed, 14 Mar 2018 06:09:26 -0700 (PDT) In-Reply-To: References: From: Pedro Larroy Date: Wed, 14 Mar 2018 14:09:26 +0100 Message-ID: Subject: Re: call for contributions to next MXNet release To: dev@mxnet.incubator.apache.org Content-Type: multipart/alternative; boundary="089e0823b868add6f505675f15ed" --089e0823b868add6f505675f15ed Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Patric Does it make sense to add instructions to link against mkl in the install docs? For example in OSX you can use MKL by downloading https://github.com/intel/mkl-dnn/releases and adding MKL_RT_LIBRARY and MKL_INCLUDE_DIR plus -DUSE_MKL_IF_AVAILABLE=3DON -DUSE_MKLML_MKL=3DON -DUSE_MKLDNN=3DON This is not documented in the website. What's the performance increase of using MKL in osx when running in CPU mode? Pedro On Wed, Mar 14, 2018 at 1:54 PM, Zhao, Patric wrote= : > My fault, typo for your name, Larroy :( > > > -----Original Message----- > > From: Zhao, Patric [mailto:patric.zhao@intel.com] > > Sent: Wednesday, March 14, 2018 8:40 PM > > To: dev@mxnet.incubator.apache.org; Huang, Jin1 > > Subject: RE: call for contributions to next MXNet release > > > > Thanks, Larryo. > > > > This is a PR to fix this issue, https://github.com/apache/incubator- > > mxnet/pull/10075 > > The issue will be gone after this PR is merged. > > > > For the whole logic, we are investigating now and maybe propose a new > > approach for Makefile and CMake. > > > > > -----Original Message----- > > > From: Pedro Larroy [mailto:pedro.larroy.lists@gmail.com] > > > Sent: Wednesday, March 14, 2018 8:31 PM > > > To: dev@mxnet.incubator.apache.org > > > Subject: Re: call for contributions to next MXNet release > > > > > > Hi > > > > > > Can you please fix the build logic? > > > https://github.com/apache/incubator- > > > mxnet/blob/master/CMakeLists.txt#L158 > > > > > > https://github.com/apache/incubator-mxnet/issues/10072 > > > > > > It wrongly assumes that you have MKL installed, MKLDNN needs to check > > > if MKL is available before, or be disabled by default, also in non > intel > > platforms. > > > > > > Pedro > > > > > > On Sun, Mar 11, 2018 at 2:43 PM, Zhao, Patric > > > wrote: > > > > > > > Steffen, really thanks for the helps and I totally agree with you > > > > and Marco's suggestions. > > > > I will summarize the open issues and status for the review soon. > > > > > > > > > What is your github handle? > > > > Github ID: Patric Zhao, https://github.com/pengzhao-intel/ Da > Zheng, > > > > https://github.com/zheng-da/ > > > > > > > > > - do you have design docs we can link to? Does the doc cover > > > > > packaging, > > > > use > > > > > of MXNet with full MKL (I understand there are license issues, bu= t > > > > > we do > > > > have > > > > > users who are or plan to use MXNet with the complete MKL package, > > > > > not > > > > just > > > > > DNN subset)? > > > > Design doc: https://cwiki.apache.org/confluence/display/MXNET/The+ > > > > design+of+MKLDNN+integration > > > > It's a good suggestion for the full MKL package and we will add the > > > > related part in the doc. > > > > > > > > > - do you have performance measurements (or plan to measure) to > > > > > include in release notes? > > > > Yes, we have tested the performance on all C4/C5 instances > > > > (8x,4x,2x,xlarge,large). And the accuracy are verified as well. > > > > We plan to publish these data both in the release note and mxnet > > > > website ( https://mxnet.incubator.apache.org/faq/perf.html). > > > > > > > > > - should we talk about the package at the Apr 24th meetup in > Seattle? > > > > We're based in Shanghai, China; so maybe @Da Zheng? > > > > > > > > > > > > > -----Original Message----- > > > > > From: Steffen Rochel [mailto:steffenrochel@gmail.com] > > > > > Sent: Sunday, March 11, 2018 6:11 PM > > > > > To: dev@mxnet.incubator.apache.org > > > > > Cc: marco.g.abreu@googlemail.com > > > > > Subject: Re: call for contributions to next MXNet release > > > > > > > > > > Patric - added MKL-DNN to the project list. What is your github > handle? > > > > > I do agree with Marco that we need to resolve disable tests, > > > > > broken > > > > features > > > > > etc. Jira looks like the right answer to create a list of known > issues. > > > > > Questions I do have: > > > > > - do you have design docs we can link to? Does the doc cover > > > > > packaging, > > > > use > > > > > of MXNet with full MKL (I understand there are license issues, bu= t > > > > > we do > > > > have > > > > > users who are or plan to use MXNet with the complete MKL package, > > > > > not > > > > just > > > > > DNN subset)? > > > > > - do you have performance measurements (or plan to measure) to > > > > > include in release notes? > > > > > - should we talk about the package at the Apr 24th meetup in > Seattle? > > > > > > > > > > Steffen > > > > > > > > > > On Sat, Mar 10, 2018 at 4:40 AM Zhao, Patric > > > > > > > > > > wrote: > > > > > > > > > > > Hi Marco, > > > > > > > > > > > > Thanks for the inputs. > > > > > > > > > > > > MKL-DNN is just merged to the master branch in a month. I agree > > > > > > that it's not very mature. > > > > > > But, in my mind, there're NO major issues in the current > > > > implementation. > > > > > > > > > > > > The previous data race (flaky test) issue is fixed by Zheng Da. > > > > > > We have submitted the PRs to fix the building issues and setup > > > > > > Clang CI environment, such as in OSX and Cmake. > > > > > > Meanwhile, we are actively working on the MXNET for the > > > > > > performance, functionality and usability improvements. > > > > > > > > > > > > More positively, I think we should summarize the open issues, > > > > > > and we can focus on these issues you've mentioned. > > > > > > > > > > > > Thanks, > > > > > > > > > > > > --Patric > > > > > > > > > > > > > -----Original Message----- > > > > > > > From: Marco de Abreu [mailto:marco.g.abreu@googlemail.com] > > > > > > > Sent: Saturday, March 10, 2018 9:36 AM > > > > > > > To: dev@mxnet.incubator.apache.org > > > > > > > Subject: Re: call for contributions to next MXNet release > > > > > > > > > > > > > > Hello Patric, > > > > > > > > > > > > > > please be aware of the fact that there are still a lot of > > > > > > > disabled > > > > > > tests, open > > > > > > > MKLDNN issues, broken features and flaky tests that have not > > > > > > > been addressed yet. We agreed on merging MKLDNN for the time > > > > > > > being to allow broad testing and that we will revisit the > > > > > > > state a bit before the next > > > > > > release. > > > > > > > At the moment, I'd not be in favour of having MKLDNN being > > > > > > > part of > > > > it. > > > > > > > > > > > > > > Best regards, > > > > > > > Marco > > > > > > > > > > > > > > Zhao, Patric schrieb am Sa., 10. M=C3= =A4rz > > > > > > > 2018, > > > > > > 02:30: > > > > > > > > > > > > > > > Hi Steffen, > > > > > > > > > > > > > > > > We'd like the MKL-DNN backend can be included in the next > > release. > > > > > > > > > > > > > > > > We (Intel engineers) and Zheng-Da (AWS engineer) can work > on it. > > > > > > > > > > > > > > > > Could you help add the item in the table? > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > > --Patric > > > > > > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > > > From: Steffen Rochel [mailto:steffenrochel@gmail.com] > > > > > > > > > Sent: Friday, March 9, 2018 9:29 PM > > > > > > > > > To: dev@mxnet.incubator.apache.org > > > > > > > > > Subject: call for contributions to next MXNet release > > > > > > > > > > > > > > > > > > Hi - I would like to propose the next MXNet release. > > > > > > > > > Initial draft content is listed at MXNet wiki > > > > > > > > > > > > > > > > > +P > > > > > > > > > ropo > > > > > > > > > sals > > > > > > > > > +fo > > > > > > > > > r+next+MXNet+Release>. > > > > > > > > > I would like to call to all contributors to add features > > > > > > > > > you are working > > > > > > > > on and > > > > > > > > > would like to see included in the release. Suggested code > > > > > > > > > freeze is March 30th with target release by mid April. > > > > > > > > > > > > > > > > > > Anirudh Subramanian and Chris Olivier have volunteered to > > > > > > > > > co-manage the release. > > > > > > > > > > > > > > > > > > Mark your date: we are planing public meetup on Apr 24th > > > > > > > > > in > > > > Seattle. > > > > > > > > > Details to follow. > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > Steffen > > > > > > > > > > > > > > > > > > > --089e0823b868add6f505675f15ed--