From dev-return-4020-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Fri Aug 31 11:38:35 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 81AE5180675 for ; Fri, 31 Aug 2018 11:38:34 +0200 (CEST) Received: (qmail 41897 invoked by uid 500); 31 Aug 2018 09:38:33 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 41874 invoked by uid 99); 31 Aug 2018 09:38:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Aug 2018 09:38:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 20CFEC6CA1 for ; Fri, 31 Aug 2018 09:38:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.39 X-Spam-Level: ** X-Spam-Status: No, score=2.39 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id VBvBePz6YC9f for ; Fri, 31 Aug 2018 09:38:27 +0000 (UTC) Received: from mail-lf1-f53.google.com (mail-lf1-f53.google.com [209.85.167.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C6A825F27D for ; Fri, 31 Aug 2018 09:38:26 +0000 (UTC) Received: by mail-lf1-f53.google.com with SMTP id h64-v6so9458212lfi.10 for ; Fri, 31 Aug 2018 02:38:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=g4Hy0U5peggf1fZlwkgswJw8j1zUBVn0XiMx+ubljU0=; b=U/qz1ojXeUW+o+NB09oDwUrov9H1hGYteymYIOr33/eh5UqH2U4RCuTC9osUh7S3kx 3RymTidmKEtJiBOmn9Urdb3MeWJiT2K8oxGzco6w8skC3Z2wI6jD2o4DMdEcwX+l/BU7 5Rpd/y9mRDp6pq+GMAbDmqQc+XEvHM/idce2Ro5rSdTR8u9MvK8Ak0VoASZ9E9q4sr3s Pl/3HyOTlvYPVaJhMI4bYdxmkMpLVUx8l6YPd5NVk11njxD3hGZQtMhrgFR8v3cJ30tN Y24extT5D7aPvpRd8R9IL7LhRwOmzxCI8n/3DfZ6i31tA272TdGugetHOR0NishNGwlj +LkQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=g4Hy0U5peggf1fZlwkgswJw8j1zUBVn0XiMx+ubljU0=; b=j6Q0UZRALV2j41jDZhxM0w+1W0S48fzEys5zXnWb0bOnFxhw+3/y9z+SVibSbaVNok BjgDQTXACwGjoHNMfD/2/nPQDVsaHmXe+XZT5pVkNTysw38MVaRuIj5OnJVjCw2lAz9b S15qkRlYrOEf/jBjdBcd/j0g/mhG5vn3UqcgCntouzb3MVtrDTTPaEgA3N+hMpy1U8Jk 0u0OR1GbGoWhWmudKumR/brkPNKSC1hsdwMlAXAs6GmswyIPM0O5e3021iVLUc3ecpkC j9hmSOHtrVnc/wNi8Kyfh5CvzH8j5dxcBSmr8ohQvdi4nIvZi8HmoHG/OR5pmhw4LODC IFbw== X-Gm-Message-State: APzg51C7Hx1QNwgT8CvBymLLcxxQggfST3JlZtUFHXE/Kl++dnLylkJJ sBw5rahQUbFoFW+AgFURvf0n8WdrnVyuBvujnMpTS1b8 X-Google-Smtp-Source: ANB0VdaCh6jA5F45UlMgeK3FQnv2EiQpx2f9BW9nYSfJIhYvLCvZXmk8L0pJP06Jvfvb7pxrnNlLXGp47ovWGwaZKso= X-Received: by 2002:a19:500f:: with SMTP id e15-v6mr9576903lfb.71.1535708305606; Fri, 31 Aug 2018 02:38:25 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Pedro Larroy Date: Fri, 31 Aug 2018 11:38:13 +0200 Message-ID: Subject: Re: Release plan - MXNET 1.3 To: dev@mxnet.incubator.apache.org Content-Type: multipart/alternative; boundary="00000000000008ce8c0574b7f447" --00000000000008ce8c0574b7f447 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi The armv7 docker builds are broken due to a problem with dockcross. Shall we add this to the release notes? I'm working on a fix. Best would be to get the fix on the release branch. https://github.com/apache/incubator-mxnet/issues/12421 Pedro On Fri, Aug 31, 2018 at 2:38 AM Roshani Nagmote wrote: > Hi all, > > I was waiting to run nightly builds to pass on the release branch. So RC0 > was a bit delayed. > Now, we have tagged the release candidate! Thanks a lot Sheng for helping > with this! > > https://github.com/apache/incubator-mxnet/releases/tag/1.3.0.rc0 > > Voting process to test RC0 will start after Scala package gets published = to > maven repositories. > I had an offline discussion with Naveen and Qing who will be working on > publishing Scala packages. They want to include Scala packages in testing > as well. > > I will communicate timelines for voting soon. > > Thanks, > Roshani > > > > On Thu, Aug 23, 2018 at 10:24 AM kellen sunderland < > kellen.sunderland@gmail.com> wrote: > > > Great news! Thanks for the efforts Roshani + Sheng. > > > > On Thu, Aug 23, 2018 at 6:58 PM Roshani Nagmote < > roshaninagmote2@gmail.com > > > > > wrote: > > > > > Release branch v1.3.x was cut yesterday night. Thanks, @Sheng for > helping > > > with this and merging a bunch of PRs. I will be running tests on the > > branch > > > and move forward with the release steps now. :) > > > Thanks, > > > Roshani > > > > > > On Wed, Aug 22, 2018 at 11:12 AM Roshani Nagmote < > > > roshaninagmote2@gmail.com> > > > wrote: > > > > > > > Thanks Patric for reviewing the notes. Updated the doc with MKL-DNN > > > points > > > > you mentioned accordingly. > > > > > > > > Regards, > > > > Roshani > > > > > > > > On Tue, Aug 21, 2018 at 8:03 PM Zhao, Patric > > > > wrote: > > > > > > > >> Hi Roshani, > > > >> > > > >> Good notes :) > > > >> > > > >> Several items about the performance and MKL-DNN in the below, plea= se > > > help > > > >> take a review. > > > >> > > > >> @Da, Alex, if anything about MKL-DNN is missed, feel free to add. > > > >> > > > >> *Performance improvement > > > >> +Support for dot(dns, csr) =3D dns and dot(dns, csr.T) =3D dns on = CPU > > > >> https://github.com/apache/incubator-mxnet/pull/11113 > > > >> +Performance improvement for Batch Dot on CPU from mshadow > > > >> https://github.com/dmlc/mshadow/pull/342 > > > >> -Fix the topk regression issue (#12197) > > > >> This is the bugfix rather than performance improvements > > > >> > > > >> > > > >> *MKL-DNN > > > >> More functionality supports: > > > >> +Support more activation functions, "sigmoid", "tanh", "softrelu" > > > >> https://github.com/apache/incubator-mxnet/pull/10336 > > > >> > > > >> Debugging functionality: > > > >> +Result check > > > >> https://github.com/apache/incubator-mxnet/pull/12069 > > > >> +Backend switch > > > >> https://github.com/apache/incubator-mxnet/pull/12058 > > > >> > > > >> Thanks, > > > >> > > > >> --Patric > > > >> > > > >> > -----Original Message----- > > > >> > From: Roshani Nagmote [mailto:roshaninagmote2@gmail.com] > > > >> > Sent: Wednesday, August 22, 2018 1:53 AM > > > >> > To: dev@mxnet.incubator.apache.org > > > >> > Subject: Re: Release plan - MXNET 1.3 > > > >> > > > > >> > Hi, > > > >> > > > > >> > Thank you everyone for helping to clear release blockers. CI tes= ts > > > were > > > >> failing > > > >> > so we delayed RC by some time. But now the tests are passing and > we > > > are > > > >> > ready to cut the release branch. > > > >> > > > > >> > I have drafted release notes here: > > > >> > > > https://cwiki.apache.org/confluence/display/MXNET/Apache+MXNet+%28in > > > >> > cubating%29+1.3.0+Release+Notes > > > >> > > > > >> > > > > >> > Please take a look and update if I have missed anything. I will = be > > > >> cutting > > > >> > RC0 tomorrow. > > > >> > > > > >> > Thanks, > > > >> > Roshani > > > >> > > > > >> > On Thu, Aug 16, 2018 at 2:28 PM Roshani Nagmote > > > >> > > > > >> > wrote: > > > >> > > > > >> > > Sure will do. thanks. > > > >> > > > > > >> > > -Roshani > > > >> > > > > > >> > > On Thu, Aug 16, 2018 at 11:53 AM Afrooze, Sina < > > sina.beh@gmail.com> > > > >> > wrote: > > > >> > > > > > >> > >> Hi Roshani - Can you please make sure that this fix (which is > > > already > > > >> > >> merged to master) is also merged to the stable branch for > 1.3.0: > > > >> > >> https://github.com/apache/incubator-mxnet/pull/11493 - Thanks= , > > > Sina > > > >> > >> > > > >> > >> > > > >> > >> =EF=BB=BFOn 8/16/18, 10:51 AM, "Roshani Nagmote" > > > >> > > > > >> > >> wrote: > > > >> > >> > > > >> > >> Hi all, > > > >> > >> > > > >> > >> Release status: > > > >> > >> > > > >> > >> Currently, for release 1.3.0 there are a couple of issues > > open > > > >> > >> which needs > > > >> > >> to be resolved before cutting RC. > > > >> > >> > > > >> > >> The current date we are looking at for cutting RC0 is > > > >> 08/17(Friday). > > > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> Open issues which need to be looked at before cutting RC: > > > >> > >> > > > >> > >> 1. Topk regression issue > > > >> > >> > > > - > > > >> > >> #12202 PR > > > >> > >> with fix < > > > >> https://github.com/apache/incubator-mxnet/pull/12202> > > > >> > >> 2. Excessive memory allocation issue > > > >> > >> > > > - > > > >> > >> #12184 PR > > > >> > >> with fix < > > > >> https://github.com/apache/incubator-mxnet/pull/12184> > > > >> > >> 3. Test_io.test_csvIter breaks on CentOS > > > >> > >> > > > - > > > >> > >> #12189 PR > > > >> > >> with fix > > > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> @committers, could you please help review these PRs and g= et > > > them > > > >> > >> merged? > > > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> Thanks, > > > >> > >> > > > >> > >> Roshani > > > >> > >> > > > >> > >> On Tue, Aug 14, 2018 at 12:46 PM Roshani Nagmote < > > > >> > >> roshaninagmote2@gmail.com> > > > >> > >> wrote: > > > >> > >> > > > >> > >> > Talked to the person who ran resnet50 benchmarks offlin= e. > > > Build > > > >> > >> flag was > > > >> > >> > not properly set so there was a difference in performan= ce > > > >> > >> numbers observed. > > > >> > >> > There is no issue caught and he was able to get the sam= e > > > >> results as > > > >> > >> > mentioned here > > > >> https://mxnet.incubator.apache.org/faq/perf.html > > > >> > >> > < > > > >> https://mxnet.incubator.apache.org/faq/perf.html#scoring-results> > > > >> > >> > > > > >> > >> > We are good here. > > > >> > >> > > > > >> > >> > Thanks, > > > >> > >> > Roshani > > > >> > >> > > > > >> > >> > On Mon, Aug 13, 2018 at 4:08 PM Roshani Nagmote < > > > >> > >> roshaninagmote2@gmail.com> > > > >> > >> > wrote: > > > >> > >> > > > > >> > >> >> Hi Dom, > > > >> > >> >> > > > >> > >> >> I verified resnet50 run on MXNet master branch. Checke= d > on > > > >> > >> single gpu > > > >> > >> >> machine. Numbers match. I didn't see any performance > > > >> degradation. > > > >> > >> >> > > > >> https://mxnet.incubator.apache.org/faq/perf.html#scoring-results > > > >> > >> >> > > > >> > >> >> Can you please give me more details on the instance ty= pe > > and > > > >> > >> script you > > > >> > >> >> ran exactly so that I can try to reproduce it again? > > > >> > >> >> > > > >> > >> >> Thanks, > > > >> > >> >> Roshani > > > >> > >> >> > > > >> > >> >> > > > >> > >> >> On Mon, Aug 13, 2018 at 12:31 PM Roshani Nagmote < > > > >> > >> >> roshaninagmote2@gmail.com> wrote: > > > >> > >> >> > > > >> > >> >>> This is not a major feature. I meant other new featur= e > > > >> > >> requests PR won't > > > >> > >> >>> be accepted in 1.3 release now. > > > >> > >> >>> Bug fixes will be accepted. I will be trying to > reproduce > > > the > > > >> > >> regression > > > >> > >> >>> Dom mentioned today. :) > > > >> > >> >>> > > > >> > >> >>> Thanks, > > > >> > >> >>> Roshani > > > >> > >> >>> > > > >> > >> >>> On Mon, Aug 13, 2018 at 12:06 PM Naveen Swamy > > > >> > >> > > >> > >> > > > > >> > >> >>> wrote: > > > >> > >> >>> > > > >> > >> >>>> Is this is a major feature? This is a regression tha= t > > Dom > > > is > > > >> > >> reporting > > > >> > >> >>>> wrt > > > >> > >> >>>> to performance > > > >> > >> >>>> > > > >> > >> >>>> On Mon, Aug 13, 2018 at 11:38 AM, Roshani Nagmote < > > > >> > >> >>>> roshaninagmote2@gmail.com > > > >> > >> >>>> > wrote: > > > >> > >> >>>> > > > >> > >> >>>> > Thanks for reporting this issue Dom. > > > >> > >> >>>> > 08/10 (Frida)y was the major feature freeze date. = We > > > >> won't be > > > >> > >> >>>> accepting any > > > >> > >> >>>> > new features now for MXNet 1.3 release. > > > >> > >> >>>> > RC0 will be cut on 08/17(Friday). > > > >> > >> >>>> > > > > >> > >> >>>> > Will be verifying the performance degradation issu= e > > > >> mentioned. > > > >> > >> >>>> > > > > >> > >> >>>> > Thanks, > > > >> > >> >>>> > Roshani > > > >> > >> >>>> > > > > >> > >> >>>> > On Mon, Aug 13, 2018 at 8:45 AM Divakaruni, Domini= c > > > >> > >> >>>> > wrote: > > > >> > >> >>>> > > > > >> > >> >>>> > > Hi all, We tested resnet50 on MXNet built from > > master > > > >> > >> branch on > > > >> > >> >>>> Friday > > > >> > >> >>>> > and > > > >> > >> >>>> > > were seeing degraded performance on GPU - about > 50% > > > >> > >> slower compared > > > >> > >> >>>> to > > > >> > >> >>>> > > these values here > > > >> > >> https://mxnet.incubator.apache.org/faq/perf.html. > > > >> > >> >>>> FWIW > > > >> > >> >>>> > > this slowdown was seen for both MXNet as well as > the > > > TRT > > > >> > >> integrated > > > >> > >> >>>> > MXNet. > > > >> > >> >>>> > > > > > >> > >> >>>> > > Something for you all to verify before or after > you > > > cut > > > >> > >> the RC. > > > >> > >> >>>> > > > > > >> > >> >>>> > > Thx! > > > >> > >> >>>> > > > > > >> > >> >>>> > > On 8/13/18, 4:34 AM, "kellen sunderland" < > > > >> > >> >>>> kellen.sunderland@gmail.com> > > > >> > >> >>>> > > wrote: > > > >> > >> >>>> > > > > > >> > >> >>>> > > Hey Roshani, > > > >> > >> >>>> > > > > > >> > >> >>>> > > Has a RC branch already been cut? If so, a > > quick > > > >> heads > > > >> > >> up that > > > >> > >> >>>> I > > > >> > >> >>>> > think > > > >> > >> >>>> > > this commit should probably get into RC0 for > > 1.3. > > > >> > >> >>>> > > > > > >> > >> >>>> > > https://github.com/apache/incubator-mxnet/commit= / > > > >> > >> >>>> > ee8755a2531b322fec29c9c3d2aa3b8738da41f3 > > > >> > >> >>>> > > > > > >> > >> >>>> > > It won't cause issues for users, but from a > > > >> versioning > > > >> > >> >>>> compatibility > > > >> > >> >>>> > > perspective it's probably better that we > remove > > > >> these > > > >> > >> functions > > > >> > >> >>>> in > > > >> > >> >>>> > this > > > >> > >> >>>> > > release. This way we don't have to worry abo= ut > > > major > > > >> > >> bumps in > > > >> > >> >>>> the > > > >> > >> >>>> > next > > > >> > >> >>>> > > release if they're removed. > > > >> > >> >>>> > > > > > >> > >> >>>> > > -Kellen > > > >> > >> >>>> > > > > > >> > >> >>>> > > > > > >> > >> >>>> > > On Fri, Aug 10, 2018 at 7:24 PM Roshani > Nagmote > > < > > > >> > >> >>>> > > roshaninagmote2@gmail.com> > > > >> > >> >>>> > > wrote: > > > >> > >> >>>> > > > > > >> > >> >>>> > > > Thanks Kellen and everyone else for workin= g > to > > > get > > > >> > >> TensorRT PR > > > >> > >> >>>> > > merged! > > > >> > >> >>>> > > > @Sina, I will be keeping track of that iss= ue > > and > > > >> fixes > > > >> > >> to get > > > >> > >> >>>> in > > > >> > >> >>>> > the > > > >> > >> >>>> > > > release. > > > >> > >> >>>> > > > > > > >> > >> >>>> > > > We are starting code freeze for 1.3 releas= e > > > >> today. A > > > >> > >> release > > > >> > >> >>>> > > candidate will > > > >> > >> >>>> > > > be cut on 08/17. > > > >> > >> >>>> > > > Feel free to add any other > > comments/suggestions. > > > >> > >> >>>> > > > > > > >> > >> >>>> > > > Thanks, > > > >> > >> >>>> > > > Roshani > > > >> > >> >>>> > > > > > > >> > >> >>>> > > > On Fri, Aug 10, 2018 at 5:39 AM kellen > > > sunderland > > > >> < > > > >> > >> >>>> > > > kellen.sunderland@gmail.com> wrote: > > > >> > >> >>>> > > > > > > >> > >> >>>> > > > > All merged and ready to go from my side > > > Roshani > > > >> (the > > > >> > >> >>>> TensorRT > > > >> > >> >>>> > PR). > > > >> > >> >>>> > > > > > > > >> > >> >>>> > > > > I agree with Sina that issue 12116 looks > > it's > > > a > > > >> > >> blocker. > > > >> > >> >>>> I'll > > > >> > >> >>>> > try > > > >> > >> >>>> > > and > > > >> > >> >>>> > > > > reproduce it locally to get another > > datapoint. > > > >> > >> >>>> > > > > > > > >> > >> >>>> > > > > On Fri, Aug 10, 2018 at 3:15 AM Afrooze, > > Sina > > > < > > > >> > >> >>>> > sina.beh@gmail.com> > > > >> > >> >>>> > > > wrote: > > > >> > >> >>>> > > > > > > > >> > >> >>>> > > > > > Hi Roshani - I think this regression > issue > > > is > > > >> a > > > >> > >> release > > > >> > >> >>>> > blocker: > > > >> > >> >>>> > > > > > > > > >> > >> https://github.com/apache/incubator-mxnet/issues/12116 > > > >> > >> >>>> - Sina > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > On 8/8/18, 12:40 PM, "Roshani Nagmote"= < > > > >> > >> >>>> > > roshaninagmote2@gmail.com> > > > >> > >> >>>> > > > > wrote: > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > Thanks, Kellen for letting me know= . > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > On Wed, Aug 8, 2018 at 12:09 PM > kellen > > > >> > >> sunderland < > > > >> > >> >>>> > > > > > kellen.sunderland@gmail.com> wrote= : > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > > Hey Roshani, I think it should b= e > > > ready > > > >> by > > > >> > >> Friday. > > > >> > >> >>>> > > > > > > > > > >> > >> >>>> > > > > > > On Tue, Aug 7, 2018, 10:20 PM > > Roshani > > > >> > >> Nagmote < > > > >> > >> >>>> > > > > > roshaninagmote2@gmail.com> > > > >> > >> >>>> > > > > > > wrote: > > > >> > >> >>>> > > > > > > > > > >> > >> >>>> > > > > > > > Thanks Kellen. Yes, we were > > treating > > > >> this > > > >> > >> PR as a > > > >> > >> >>>> > release > > > >> > >> >>>> > > > > blocker. > > > >> > >> >>>> > > > > > Do you > > > >> > >> >>>> > > > > > > > have any ETA by which it will = be > > > >> completed? > > > >> > >> >>>> Approximate > > > >> > >> >>>> > > time > > > >> > >> >>>> > > > will > > > >> > >> >>>> > > > > > also > > > >> > >> >>>> > > > > > > > work. > > > >> > >> >>>> > > > > > > > @zhi, Thanks for bringing this > PR > > > into > > > >> > >> notice. I > > > >> > >> >>>> will > > > >> > >> >>>> > > keep a > > > >> > >> >>>> > > > > track > > > >> > >> >>>> > > > > > of it. > > > >> > >> >>>> > > > > > > > > > > >> > >> >>>> > > > > > > > -Roshani > > > >> > >> >>>> > > > > > > > > > > >> > >> >>>> > > > > > > > On Tue, Aug 7, 2018 at 11:30 A= M > > > >> Joshua Z. > > > >> > >> Zhang < > > > >> > >> >>>> > > > > > cheungchih@gmail.com> > > > >> > >> >>>> > > > > > > > wrote: > > > >> > >> >>>> > > > > > > > > > > >> > >> >>>> > > > > > > > > I strongly suggest to track > this > > > PR > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> https://github.com/apache/incubator-mxnet/pull/11908 > > > >> > >> >>>> > < > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> https://github.com/apache/incubator-mxnet/pull/11908 > > > >> > >> >>>> > > > > > >> > >> >>>> > > in 1.3 > > > >> > >> >>>> > > > > > release > > > >> > >> >>>> > > > > > > > > which fixed the usability > issue > > > for > > > >> > >> lower end > > > >> > >> >>>> > machines > > > >> > >> >>>> > > that > > > >> > >> >>>> > > > > > don=E2=80=99t have > > > >> > >> >>>> > > > > > > as > > > >> > >> >>>> > > > > > > > > large shared memory space as > ec2 > > > >> > >> instances. > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> > > > > > > > > Best, > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> > > > > > > > > - Zhi > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> > > > > > > > > > On Aug 7, 2018, at 9:05 AM= , > > > >> Roshani > > > >> > >> Nagmote < > > > >> > >> >>>> > > > > > > roshaninagmote2@gmail.com > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> > > > > > > > > wrote: > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > > Hi all, > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > > Right now, we are delaying > > MXNet > > > >> 1.3 > > > >> > >> release > > > >> > >> >>>> for > > > >> > >> >>>> > > pending > > > >> > >> >>>> > > > > > TensorRT PR > > > >> > >> >>>> > > > > > > ( > > > >> > >> >>>> > > > > > > > > > https://github.com/apache/ > > > >> > >> >>>> > incubator-mxnet/pull/11325 > > > >> > >> >>>> > > ). > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > > I wanted to ask everyone f= or > > > their > > > >> > >> opinions > > > >> > >> >>>> if we > > > >> > >> >>>> > > should > > > >> > >> >>>> > > > > delay > > > >> > >> >>>> > > > > > the > > > >> > >> >>>> > > > > > > > > release > > > >> > >> >>>> > > > > > > > > > to get tensorRT integratio= n > in > > > or > > > >> we > > > >> > >> should go > > > >> > >> >>>> > ahead > > > >> > >> >>>> > > with > > > >> > >> >>>> > > > the > > > >> > >> >>>> > > > > > release > > > >> > >> >>>> > > > > > > > and > > > >> > >> >>>> > > > > > > > > > include tensorRT in next > > > release. > > > >> > >> Please > > > >> > >> >>>> provide > > > >> > >> >>>> > > > suggestions. > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > > Thanks, > > > >> > >> >>>> > > > > > > > > > Roshani > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > > On Mon, Aug 6, 2018 at 12:= 45 > > AM > > > >> Hagay > > > >> > >> Lupesko > > > >> > >> >>>> < > > > >> > >> >>>> > > > > > lupesko@gmail.com> > > > >> > >> >>>> > > > > > > > wrote: > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > >> Some thoughts: why not ke= ep > > it > > > >> out of > > > >> > >> 1.3, > > > >> > >> >>>> and > > > >> > >> >>>> > > merge it > > > >> > >> >>>> > > > into > > > >> > >> >>>> > > > > > master > > > >> > >> >>>> > > > > > > so > > > >> > >> >>>> > > > > > > > > it > > > >> > >> >>>> > > > > > > > > >> can go out with 1.4 > instead? > > > >> > >> >>>> > > > > > > > > >> Pros: > > > >> > >> >>>> > > > > > > > > >> - Reduce quality risks fo= r > > 1.3 > > > >> > >> >>>> > > > > > > > > >> - More time to test and g= et > > > >> feedback > > > >> > >> before > > > >> > >> >>>> > release > > > >> > >> >>>> > > > > > > > > >> - Avoid further delays in > 1.3 > > > >> release > > > >> > >> (lots > > > >> > >> >>>> of > > > >> > >> >>>> > good > > > >> > >> >>>> > > stuff > > > >> > >> >>>> > > > > > there > > > >> > >> >>>> > > > > > > > already > > > >> > >> >>>> > > > > > > > > for > > > >> > >> >>>> > > > > > > > > >> users) > > > >> > >> >>>> > > > > > > > > >> Cons: > > > >> > >> >>>> > > > > > > > > >> - People will need to get > > > master > > > >> to > > > >> > >> >>>> experiment > > > >> > >> >>>> > with > > > >> > >> >>>> > > TRT > > > >> > >> >>>> > > > (not > > > >> > >> >>>> > > > > > a major > > > >> > >> >>>> > > > > > > > > issue > > > >> > >> >>>> > > > > > > > > >> IMO) > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > > > > > >> Besides, TRT requires a > build > > > >> flag > > > >> > >> anyway, so > > > >> > >> >>>> > MXNet > > > >> > >> >>>> > > users > > > >> > >> >>>> > > > > > consuming > > > >> > >> >>>> > > > > > > > > built > > > >> > >> >>>> > > > > > > > > >> packages (PyPi, Scala) wi= ll > > > >> anyway > > > >> > >> not be > > > >> > >> >>>> able to > > > >> > >> >>>> > > try it > > > >> > >> >>>> > > > out > > > >> > >> >>>> > > > > > unless > > > >> > >> >>>> > > > > > > > > >> building from source... > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > > > > > >> Thoughts? > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > > > > > >> On Sun, Aug 5, 2018 at > 10:38 > > PM > > > >> > >> Steffen > > > >> > >> >>>> Rochel < > > > >> > >> >>>> > > > > > > > steffenrochel@gmail.com > > > >> > >> >>>> > > > > > > > > > > > > >> > >> >>>> > > > > > > > > >> wrote: > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > > > > > >>> Marek, Kellen, Jun, Da, > > Eric, > > > >> myself > > > >> > >> and a > > > >> > >> >>>> few > > > >> > >> >>>> > > other > > > >> > >> >>>> > > > people > > > >> > >> >>>> > > > > > > discussed > > > >> > >> >>>> > > > > > > > > >>> offline about TensorRT > > > >> integration > > > >> > >> PR ( > > > >> > >> >>>> > > > > > > > > >>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11325 > > > ). > > > >> > >> >>>> > > > We > > > >> > >> >>>> > > > > > do > > > >> > >> >>>> > > > > > > agree > > > >> > >> >>>> > > > > > > > > that > > > >> > >> >>>> > > > > > > > > >>> it > > > >> > >> >>>> > > > > > > > > >>> would be good to include > the > > > PR > > > >> into > > > >> > >> >>>> upcoming 1.3 > > > >> > >> >>>> > > > release, > > > >> > >> >>>> > > > > > but are > > > >> > >> >>>> > > > > > > > all > > > >> > >> >>>> > > > > > > > > >>> concerned about the risk > > > >> involved > > > >> > >> and the > > > >> > >> >>>> > breaking > > > >> > >> >>>> > > API > > > >> > >> >>>> > > > > > change. The > > > >> > >> >>>> > > > > > > > > >>> discussion converged to > > > >> following > > > >> > >> proposal. > > > >> > >> >>>> (1) > > > >> > >> >>>> > > change to > > > >> > >> >>>> > > > > > contrib > > > >> > >> >>>> > > > > > > PR > > > >> > >> >>>> > > > > > > > > and > > > >> > >> >>>> > > > > > > > > >>> (2) define a different t= op > > > >> level API > > > >> > >> to > > > >> > >> >>>> indicate > > > >> > >> >>>> > > that the > > > >> > >> >>>> > > > > > package > > > >> > >> >>>> > > > > > > is > > > >> > >> >>>> > > > > > > > > part > > > >> > >> >>>> > > > > > > > > >>> of contrib and > experimental > > > >> (details > > > >> > >> of API > > > >> > >> >>>> TBD > > > >> > >> >>>> > > between > > > >> > >> >>>> > > > > > Marek, > > > >> > >> >>>> > > > > > > Kellen > > > >> > >> >>>> > > > > > > > > and > > > >> > >> >>>> > > > > > > > > >>> Eric). This change would > > allow > > > >> to > > > >> > >> include > > > >> > >> >>>> TRT > > > >> > >> >>>> > > integration > > > >> > >> >>>> > > > > > with v1.3 > > > >> > >> >>>> > > > > > > > to > > > >> > >> >>>> > > > > > > > > >>> enable users to try TRT > with > > > >> MXNet, > > > >> > >> >>>> minimize the > > > >> > >> >>>> > > risk and > > > >> > >> >>>> > > > > > avoid > > > >> > >> >>>> > > > > > > > > breaking > > > >> > >> >>>> > > > > > > > > >>> API change. > > > >> > >> >>>> > > > > > > > > >>> To accommodate the chang= e > > the > > > >> > >> request is to > > > >> > >> >>>> delay > > > >> > >> >>>> > > RC for > > > >> > >> >>>> > > > a > > > >> > >> >>>> > > > > > few > > > >> > >> >>>> > > > > > > days. > > > >> > >> >>>> > > > > > > > > >>> > > > >> > >> >>>> > > > > > > > > >>> Regards, > > > >> > >> >>>> > > > > > > > > >>> Steffen > > > >> > >> >>>> > > > > > > > > >>> > > > >> > >> >>>> > > > > > > > > >>> On Tue, Jul 31, 2018 at > 5:08 > > > PM > > > >> > >> Roshani > > > >> > >> >>>> Nagmote < > > > >> > >> >>>> > > > > > > > > >> roshaninagmote2@gmail.com > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>> wrote: > > > >> > >> >>>> > > > > > > > > >>> > > > >> > >> >>>> > > > > > > > > >>>> Hi, > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> I have created a wiki f= or > > > >> tracking > > > >> > >> MXNet > > > >> > >> >>>> 1.3 > > > >> > >> >>>> > > release > > > >> > >> >>>> > > > with > > > >> > >> >>>> > > > > > the > > > >> > >> >>>> > > > > > > > > timeline. > > > >> > >> >>>> > > > > > > > > >>>> Please take a look here= : > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>> > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> > > > > > > > > > > >> > >> >>>> > > > > > > > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > > > >> > >> >>>> > > > > > > >> > >> >>>> > > > https://cwiki.apache.org/confluence/display/MXNET/ > > > >> > >> >>>> > Apache+MXNet+%28incubating%29+1.3.0+Release+Status > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> I am still waiting for > > > >> following 2 > > > >> > >> PRs to > > > >> > >> >>>> get > > > >> > >> >>>> > > merged: > > > >> > >> >>>> > > > > > > > > >>>> TRT integration: > > > >> > >> >>>> > > > > > > > > > > >> > >> >>>> https://github.com/apache/incubator-mxnet/pull/11325 > > > >> > >> >>>> > > > > > > > > >>>> Gluon RNN: > > > >> > >> >>>> > > > > > > > > >> > >> https://github.com/apache/incubator-mxnet/pull/11482 > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> *Code freeze date is > > > >> > >> 08/02(Thursday).* > > > >> > >> >>>> Kindly > > > >> > >> >>>> > try > > > >> > >> >>>> > > to > > > >> > >> >>>> > > > > > complete > > > >> > >> >>>> > > > > > > > ongoing > > > >> > >> >>>> > > > > > > > > >>> work > > > >> > >> >>>> > > > > > > > > >>>> and get these PRs merge= d. > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> Thanks, > > > >> > >> >>>> > > > > > > > > >>>> Roshani > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>> On Mon, Jul 30, 2018 at > > 1:02 > > > PM > > > >> > >> Roshani > > > >> > >> >>>> Nagmote > > > >> > >> >>>> > < > > > >> > >> >>>> > > > > > > > > >>> roshaninagmote2@gmail.co= m > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>> wrote: > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>>>> Hi all, > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> Here is an update on > MXNet > > > 1.3 > > > >> > >> release: > > > >> > >> >>>> > > > > > > > > >>>>> I am still waiting for > > > >> following > > > >> > >> PRs to > > > >> > >> >>>> get > > > >> > >> >>>> > > merged: > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> TRT integration: > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11325 > > > >> > >> >>>> > > > > > > > > >>>>> Gluon RNN: > > > >> > >> >>>> > > > > > > > > >> > >> https://github.com/apache/incubator-mxnet/pull/11482 > > > >> > >> >>>> > > > > > > > > >>>>> Scala examples: > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11753 > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11621 > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> *New code freeze date > is: > > > >> 08/03* > > > >> > >> Please > > > >> > >> >>>> try to > > > >> > >> >>>> > > get > > > >> > >> >>>> > > > your > > > >> > >> >>>> > > > > > ongoing > > > >> > >> >>>> > > > > > > > PRs > > > >> > >> >>>> > > > > > > > > >>>>> merged by then. > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> @Pedro, I didn't inclu= de > > > your > > > >> PRs > > > >> > >> in > > > >> > >> >>>> tracking > > > >> > >> >>>> > > list as > > > >> > >> >>>> > > > you > > > >> > >> >>>> > > > > > said > > > >> > >> >>>> > > > > > > > those > > > >> > >> >>>> > > > > > > > > >>> are > > > >> > >> >>>> > > > > > > > > >>>>> not critical for now. > > Please > > > >> let > > > >> > >> me know > > > >> > >> >>>> if > > > >> > >> >>>> > > those needs > > > >> > >> >>>> > > > > to > > > >> > >> >>>> > > > > > be > > > >> > >> >>>> > > > > > > > > >> included. > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11636 > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11562 > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> I also have updated > > project > > > >> > >> proposal > > > >> > >> >>>> cwiki page > > > >> > >> >>>> > > to > > > >> > >> >>>> > > > update > > > >> > >> >>>> > > > > > the > > > >> > >> >>>> > > > > > > > status > > > >> > >> >>>> > > > > > > > > >> of > > > >> > >> >>>> > > > > > > > > >>>>> PRs. > > > >> > >> >>>> > > > > > > > > >>>>> < > > > >> > >> >>>> > > > > > > > > >>>> > > > >> > >> >>>> > > > > > > > > >>> > > > >> > >> >>>> > > > > > > > > >> > > > >> > >> >>>> > > > > > > > > > > > >> > >> >>>> > > > > > > > > > > >> > >> >>>> > > > > > > > > > >> > >> >>>> > > > > > > > > >> > >> >>>> > > > > > > > >> > >> >>>> > > > > > > >> > >> >>>> > > > https://cwiki.apache.org/confluence/display/MXNET/ > > > >> > >> >>>> > Project+Proposals+for+next+MXNet+Release > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> Please let me know if = I > am > > > >> missing > > > >> > >> >>>> something. > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> Thanks, > > > >> > >> >>>> > > > > > > > > >>>>> Roshani > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>> On Thu, Jul 26, 2018 a= t > > 1:34 > > > >> PM > > > >> > >> Pedro > > > >> > >> >>>> Larroy < > > > >> > >> >>>> > > > > > > > > >>>> > > pedro.larroy.lists@gmail.com > > > > > > > >> > >> >>>> > > > > > > > > >>>>> wrote: > > > >> > >> >>>> > > > > > > > > >>>>> > > > >> > >> >>>> > > > > > > > > >>>>>> I would like to get > these > > > PR > > > >> > >> merged: > > > >> > >> >>>> > > > > > > > > >>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11636 > > > >> > >> >>>> > > > > > > > > >>>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11562 > > > >> > >> >>>> > > > > > > > > >>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>> How much longer until > the > > > >> code > > > >> > >> freeze? > > > >> > >> >>>> > > > > > > > > >>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>> On Thu, Jul 26, 2018 = at > > > 1:44 > > > >> AM > > > >> > >> Roshani > > > >> > >> >>>> > Nagmote > > > >> > >> >>>> > > < > > > >> > >> >>>> > > > > > > > > >>>>>> > > roshaninagmote2@gmail.com> > > > >> > >> >>>> > > > > > > > > >>>>>> wrote: > > > >> > >> >>>> > > > > > > > > >>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> Hi all, > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> PRs waiting to be > merged > > > >> for 1.3 > > > >> > >> >>>> release: > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > https://github.com/apache/incubator-mxnet/pull/11325 > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> Are there any other > PRs > > > >> waiting > > > >> > >> to get > > > >> > >> >>>> > merged? > > > >> > >> >>>> > > Please > > > >> > >> >>>> > > > > > let me > > > >> > >> >>>> > > > > > > > know. > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> Release blocker issu= e: > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > >> https://github.com/apache/incubator-mxnet/issues/11853 > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> @Marco, @Kellen, > Thanks > > > for > > > >> > >> bringing up > > > >> > >> >>>> the > > > >> > >> >>>> > > important > > > >> > >> >>>> > > > > > topic. I > > > >> > >> >>>> > > > > > > > > >> agree > > > >> > >> >>>> > > > > > > > > >>>>>> with > > > >> > >> >>>> > > > > > > > > >>>>>>> you and we(internal > > Amazon > > > >> team) > > > >> > >> will be > > > >> > >> >>>> > > working on > > > >> > >> >>>> > > > > > fixing the > > > >> > >> >>>> > > > > > > > > >>>> disabled > > > >> > >> >>>> > > > > > > > > >>>>>>> tests. > > > >> > >> >>>> > > > > > > > > >>>>>>> Currently, my > colleague, > > > >> Hao Jin > > > >> > >> is > > > >> > >> >>>> working > > > >> > >> >>>> > on > > > >> > >> >>>> > > > > compiling > > > >> > >> >>>> > > > > > the > > > >> > >> >>>> > > > > > > list > > > >> > >> >>>> > > > > > > > > >> of > > > >> > >> >>>> > > > > > > > > >>>>>>> disabled tests and > > leading > > > >> the > > > >> > >> effort > > > >> > >> >>>> to fix > > > >> > >> >>>> > > them in > > > >> > >> >>>> > > > > the > > > >> > >> >>>> > > > > > next > > > >> > >> >>>> > > > > > > few > > > >> > >> >>>> > > > > > > > > >>>> days. > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> Thanks, > > > >> > >> >>>> > > > > > > > > >>>>>>> Roshani > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>> On Mon, Jul 23, 2018 > at > > > >> 6:39 PM > > > >> > >> kellen > > > >> > >> >>>> > > sunderland < > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > kellen.sunderland@gmail.com > > > >> > > > > >> > >> wrote: > > > >> > >> >>>> > > > > > > > > >>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>>> Thanks again for > > > organizing > > > >> > >> Roshani. I > > > >> > >> >>>> > > believe the > > > >> > >> >>>> > > > > > TensorRT > > > >> > >> >>>> > > > > > > > > >> work > > > >> > >> >>>> > > > > > > > > >>> is > > > >> > >> >>>> > > > > > > > > >>>>>>> ready > > > >> > >> >>>> > > > > > > > > >>>>>>>> for a merge. Thank= s > to > > > >> Marek > > > >> > >> and all > > > >> > >> >>>> the > > > >> > >> >>>> > > NVIDIA > > > >> > >> >>>> > > > > people > > > >> > >> >>>> > > > > > for > > > >> > >> >>>> > > > > > > > > >>>> iterating > > > >> > >> >>>> > > > > > > > > >>>>>> on > > > >> > >> >>>> > > > > > > > > >>>>>>>> it. If possible > could > > a > > > >> > >> committer > > > >> > >> >>>> review, > > > >> > >> >>>> > > make sure > > > >> > >> >>>> > > > > it > > > >> > >> >>>> > > > > > meets > > > >> > >> >>>> > > > > > > > > >>> their > > > >> > >> >>>> > > > > > > > > >>>>>>>> expectations and th= en > > > >> merge? > > > >> > >> PR is > > > >> > >> >>>> here: > > > >> > >> >>>> > > > > > > > > >>>>>>>> > > > >> > >> >>>> > > > > > > >> https://github.com/apache/incubator-mxnet/pull/11325 > > > >> > >> >>>> > > > > > > > > >>>>>>>> > > > >> > >> >>>> > > > > > > > > >>>>>>>> To Marco's point. > I'd > > > >> > >> recommend we > > > >> > >> >>>> review > > > >> > >> >>>> > > some of > > > >> > >> >>>> > > > > those > > > >> > >> >>>> > > > > > > > > >> disabled > > > >> > >> >>>> > > > > > > > > >>>>>> tests > > > >> > >> >>>> > > > > > > > > >>>>>>> and > > > >> > >> >>>> > > > > > > > > >>>>>>>> see how likely they > are > > > to > > > >> > >> affect users > > > >> > --00000000000008ce8c0574b7f447--