From dev-return-5143-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Tue Dec 11 18:49:09 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 694A3180671 for ; Tue, 11 Dec 2018 18:49:09 +0100 (CET) Received: (qmail 3648 invoked by uid 500); 11 Dec 2018 17:49:08 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 3633 invoked by uid 99); 11 Dec 2018 17:49:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Dec 2018 17:49:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5B97CCFE69 for ; Tue, 11 Dec 2018 17:49:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.798 X-Spam-Level: * X-Spam-Status: No, score=1.798 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id xiKnzOeKSRIN for ; Tue, 11 Dec 2018 17:49:05 +0000 (UTC) Received: from mail-yb1-f172.google.com (mail-yb1-f172.google.com [209.85.219.172]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C25FC5FC50 for ; Tue, 11 Dec 2018 17:40:18 +0000 (UTC) Received: by mail-yb1-f172.google.com with SMTP id m129so330832ybf.9 for ; Tue, 11 Dec 2018 09:40:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=vgDGiPoYpyFK880HXZI/eCcok3ZGpAuU6MS1nni580s=; b=ZsWr1twBo7/9UJbza5qoZlTmY9NqmBGnAcVjSaeQpVkX+JWn7nJfIl7LqUZCYtpj4Q vObZepFJ2VN8/tOZ1QfrKSao+xULEOpi2jrGKdoZxxyZFn3U05eeB3ywaMyuFPOaAAH2 sEHT+4yFSU1WBw7CINv8GX7QbMOgNtW9hkLxQSJqh6XfR0zcS8et7A6ZjdxtcuBHlGXR dO6CLRZtlA5vNz/4jTe5OpdOdRzfRUCo1jWjy3AKwfdsSvNq6R/C5P0Ox+VVi6/TWUiX Gs5GmxUQNGJKccnXtv2OiiP8g28ZQgt4AZxw8m87bdNQQ3cJXtfhuOYV42CkYOsFNnzS EHuA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=vgDGiPoYpyFK880HXZI/eCcok3ZGpAuU6MS1nni580s=; b=Rglix0bHMpLJhUO4UwWhlj4DH6/Hy9jmKIuq4+h0gEnB8MHmHFOkovgn/LhY/tzkAG brH1ajNJhwVJm3fS1i4W9C93eb1OVgMURqRypNTzdfooPfK8iMXR5IL37aXfdoIUPDYe dAq3ltqvvSGcHSmKxAYxXJ0DiDXPpswRNlqwFNCyDVfWtdnAeiuCbkQtJI7cDEoVnbuZ 8vFcuiWJRR7a4+rnN1TU9qvdZA8gfHRuuC7fI6JcXzVf0nN0RJ2Sy1d9qxkn9HthK/+D WF8oxqPm96dFwdK6fK5PC/ta8fgf22X3mWeuEME7lokczpM2n46d4/RXAo61+dt+prTz C1qg== X-Gm-Message-State: AA+aEWYFCAEWNp0f9zu3MG9P8ohq422y+J1Ids7nnrg0knBEAR63QOuf 53RQcgaDAfgQVWhd7wWGXPvi+imaGEmaaR+xU7rbAw== X-Google-Smtp-Source: AFSGD/UwpOBrccz5mVTbnWZtuKHnGAGiSkQokXUqJCWxSLSL7iNtw8WCoxcDf6rQEuubCvv+DAoA9XYFMpFaEl5ClOU= X-Received: by 2002:a25:6945:: with SMTP id e66mr16762876ybc.134.1544550017437; Tue, 11 Dec 2018 09:40:17 -0800 (PST) MIME-Version: 1.0 References: <438838FC-63C6-4DC2-8980-CAA7A065A000@amazon.com> In-Reply-To: <438838FC-63C6-4DC2-8980-CAA7A065A000@amazon.com> From: Naveen Swamy Date: Tue, 11 Dec 2018 09:39:41 -0800 Message-ID: Subject: Re: Include MKLDNN into default mxnet pip package To: dev@mxnet.incubator.apache.org Content-Type: multipart/alternative; boundary="000000000000209688057cc29384" --000000000000209688057cc29384 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Great effort Alex and also folks from Intel. +1 to make MKLDNN default. On Tue, Dec 11, 2018 at 9:10 AM Kumar, Vikas wrote: > +1 > > =EF=BB=BFOn 12/10/18, 8:01 PM, "Zhao, Patric" wro= te: > > +1, thanks for the efforts, Alex. > > > > > -----Original Message----- > > From: Alex Zai [mailto:azai91@gmail.com] > > Sent: Tuesday, December 11, 2018 8:00 AM > > To: dev@mxnet.incubator.apache.org > > Subject: Include MKLDNN into default mxnet pip package > > > > Continuation from the following thread: > > > https://lists.apache.org/thread.html/bcb1bd5046ff51049a0556098e756578f > > 6fa6564831d77fddb56432f@%3Cdev.mxnet.apache.org%3E > > > > I am also +1 for making it on master and testing until 1.5.0. We ca= n > decide > > later on (before 1.5.0) to enable mkldnn as default for the nightly > build (pip > > install --pre build) to try to get more feedback if needed. > > > > - What the story is like when there's no AVX instructions present o= n > CPUs. > > Do we get an illegal instruction error, or does it fallback > gracefully? > > According to this issue ( > > https://github.com/apache/incubator-mxnet/issues/11911), AVX2 is th= e > > minimum requirement for pre-build binaries. > > > > - Are there any outstanding issues when MKLDNN is enabled? > > -There is one issues with quantization int8 of mkldnn (will create > issue about > > it when team gives me reproducible code snippet). Additionally, we > are > > waiting to merge the PR to build mkldnn statically with mac/linux > when > > building from source after MKL is added to the CI. > > > > > > - MKLDNN is a submodule dependency, are we pulling the latest commi= t > or > > releases? If not we should move to releases before we make it a > default I > > agree. We should tag mxnet only to releases from now on. Currently > it is > > tagged to 0.17.1 > > > > Please let me know if there any other outstanding issues, else we > are going > > to make mkldnn / cmake default in the Make/CMakefile. > > > > Alex > > > --000000000000209688057cc29384--