From dev-return-4183-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Thu Sep 20 15:36:43 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id C138F180671 for ; Thu, 20 Sep 2018 15:36:42 +0200 (CEST) Received: (qmail 42007 invoked by uid 500); 20 Sep 2018 13:36:41 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 41990 invoked by uid 99); 20 Sep 2018 13:36:41 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Sep 2018 13:36:41 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B3E161A04DD for ; Thu, 20 Sep 2018 13:36:40 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.139 X-Spam-Level: ** X-Spam-Status: No, score=2.139 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id ytvzrLklgXiZ for ; Thu, 20 Sep 2018 13:36:35 +0000 (UTC) Received: from mail-io1-f46.google.com (mail-io1-f46.google.com [209.85.166.46]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 2587F5F381 for ; Thu, 20 Sep 2018 13:36:34 +0000 (UTC) Received: by mail-io1-f46.google.com with SMTP id y12-v6so7366612ioj.13 for ; Thu, 20 Sep 2018 06:36:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=CJF062NfLDXRdiB1NYgLWeE/HmhFHtpE3ebzsHpgWu4=; b=Oli9+ZnZjJz2uWMJICrx8zNzhokugqwtBvW1DI8qxiPL/H+FKOCVN1NkTFSNOFwdRN xCVrrF7Rzrleuar6feNobcyAOBloq0nMCA8MuLX9JS0eETlelcYWS2xT9JYq6O0f25HK aiysyKSg3q4MTcuYJnTUdq1SylAoXjxF+9Cw/zudmB7+G88/ZTJeqAWF+Q2wjyX1+yfg /TSzqPFS+b0bonR8Z0MJqh6Id6hlXKxiqd3zHCVGDf77PqR0RH+BLNkJh33nd9AbJUG7 VaYuRkPVBszf1tt0/9dJCLc5CDvxi961Lbcuu5AgBIm4PfUqQ/gyPMFBG748S2pwcsfy ViCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=CJF062NfLDXRdiB1NYgLWeE/HmhFHtpE3ebzsHpgWu4=; b=t7333LWYDxKHW4LwzVqeC5u+eOmOnMQNn/4yu08B1uH/hjIfO05izoRTQn87WGAPDf 0qf9kHVq5oxVTTvC1olGxI12sks7B/4F+GyXYBUSBlwOh9YmyIOqtzyoH+EGjkJnUVr5 fXFwIDyJE9ycjf8UHe0Idb+owaQhdT3iEbHVhWqJTd1NGQYlf9Ofb9r9K6+kf+/DvuCn Ta0Tb90QexJcz2zPp29k5YU5XfukLfwtDlVcvd9W0lhLWZy7+2DN7kB8UkbuCsdJ/HHs rtCTU3PyH/sBjHh7GtinNLr3SCFDqe0vtBNAJSmEor0D6oyE7UgN6VecsgONTI8xIEEa 8DJg== X-Gm-Message-State: APzg51DX4cb57Jgmn2FL1vuHXbeTneNlyqn1pVSf7oluqAL+qk0Tsrw2 Cn1y5v+MV9AnX0tA4gHD7cdkKpBR11o4UqLONlrHww== X-Google-Smtp-Source: ANB0VdbMgli4PrRLeIidqgCeP89oFAZvfibheY298UHGljtPaDEqHRhnNnBO5VzOKOQEKF4amjR6aZoDfPNom6jT6/Q= X-Received: by 2002:a6b:8b82:: with SMTP id n124-v6mr31258873iod.234.1537450592329; Thu, 20 Sep 2018 06:36:32 -0700 (PDT) MIME-Version: 1.0 References: <7EE05B097135E4438AAC805EE2C744E903B2CCBE@SHSMSX104.ccr.corp.intel.com> <0B919965-D240-4EA2-B106-D06C95C2446D@amazon.com> <7EE05B097135E4438AAC805EE2C744E903B2D1D9@SHSMSX104.ccr.corp.intel.com> <7EE05B097135E4438AAC805EE2C744E903B3DB08@SHSMSX104.ccr.corp.intel.com> In-Reply-To: <7EE05B097135E4438AAC805EE2C744E903B3DB08@SHSMSX104.ccr.corp.intel.com> From: Chris Olivier Date: Thu, 20 Sep 2018 06:36:21 -0700 Message-ID: Subject: Re: Remove MKLML as dependency To: dev@mxnet.incubator.apache.org Content-Type: multipart/alternative; boundary="0000000000006a6b1805764d9ce4" --0000000000006a6b1805764d9ce4 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable thanks for the info. I am still a little confused =E2=80=94 your statement = said =E2=80=9CMKL=E2=80=9D and not =E2=80=9CMKLML=E2=80=9D, so my question is st= ill the same. Are GEMMS in MKLML or just MKL? I know MKLML doesn=E2=80=99t have a blas library like th= e main MKL. On Wed, Sep 19, 2018 at 11:49 PM Lv, Tao A wrote: > Hi Chris, please kindly check the statements here: > https://github.com/intel/mkl-dnn#installation > > " Intel MKL-DNN can take advantage of optimized matrix-matrix > multiplication (GEMM) function from Intel MKL. The dynamic library with > this functionality is included in the repository. " > > " You can choose to build Intel MKL-DNN without binary dependency. The > resulting version will be fully functional, however performance of certai= n > convolution shapes and sizes and inner product relying on SGEMM function > may be suboptimal." > > -tao > > -----Original Message----- > From: Chris Olivier [mailto:cjolivier01@gmail.com] > Sent: Thursday, September 20, 2018 11:20 AM > To: dev@mxnet.incubator.apache.org > Subject: Re: Remove MKLML as dependency > > maybe I missed it, but what does MKLML have that mkldnn doesn=E2=80=99t h= ave that > makes it necessary? > > what=E2=80=99s the motivation for removing it? > > On Tue, Sep 18, 2018 at 11:31 PM Lv, Tao A wrote: > > > If you just want to test the performance, I think you need link MKL > > for BLAS and MKL-DNN for NN. Also MKL-DNN should link MKL for better > > performance. > > > > Here are some ways for you to install full MKL library if you don't > > have > > one: > > 1. Register and download from intel website: > > https://software.intel.com/en-us/mkl > > 2. Apt-get/yum: currently it need configure Intel=E2=80=99s repositorie= s. > > a. > > > https://software.intel.com/en-us/articles/installing-intel-free-libs-and-= python-yum-repo > > b. https://software.intel.com/en-us/articles/ > > thatinstalling-intel-free-libs-and-python-apt-repo > > > and-python-apt-repo> 3. pip install mkl / mkl-devel: =E2=80=98mkl=E2=80= =99 package has > > the runtime and =E2=80=98mkl-devel=E2=80=99 includes everything with th= e headers > > a. > > https://software.intel.com/en-us/articles/installing-the-intel-distrib > > ution-for-python-and-intel-performance-libraries-with-pip-and > > 4. conda install: also has mkl and mkl-devel > > a. https://anaconda.org/intel/mkl > > b. https://anaconda.org/intel/mkl-devel > > > > If you want to redistribute MKL with MXNet, you may need take care of > > the license issue. Currently, MKL is using ISSL ( > > https://software.intel.com/en-us/license/intel-simplified-software-lic > > ense > > ). > > > > -----Original Message----- > > From: Zai, Alexander [mailto:alexzai@amazon.com.INVALID] > > Sent: Wednesday, September 19, 2018 12:49 PM > > To: dev@mxnet.incubator.apache.org > > Subject: Re: Remove MKLML as dependency > > > > Will test it out tomorrow. > > > > On the side, what is the best way to test MKL build for MXnet. MKL is > > licensed? > > > > Best, > > Alex > > > > =EF=BB=BFOn 9/18/18, 7:50 PM, "Lv, Tao A" wrote: > > > > Hi Alex, > > > > Thanks for bringing this up. > > > > The original intention of MKLML is to provide a light and > > easy-to-access library for ML/DL community. It's released with MKL-DNN > > under Apache-2.0 license. > > > > AFAIK, MKL-DNN still relies on it for better performance. So I'm > > afraid there will be a performance regression in MKL pip packages if > > MKLML is simply removed. > > > > Have you ever tried the build without MKLML and how does the > > performance look like? > > > > -tao > > > > -----Original Message----- > > From: Alex Zai [mailto:azai91@gmail.com] > > Sent: Wednesday, September 19, 2018 4:49 AM > > To: dev@mxnet.incubator.apache.org > > Subject: Remove MKLML as dependency > > > > On our build from source page we have a list of blas libraries > > that are recommended: > > https://mxnet.incubator.apache.org/install/build_from_source.html > > > > MKL-DNN > > MKL > > MKLML > > Apple Accelerate > > OpenBlas > > > > MKLML is a subset of MKL ( > https://github.com/intel/mkl-dnn/issues/102) > > and therefore MKLML users can just use MKL instead. Does anyone > > see an issue with me removing this? It would simplify out doc page and > build file. > > > > Alex > > > > > > > --0000000000006a6b1805764d9ce4--