From dev-return-2347-archive-asf-public=cust-asf.ponee.io@systemml.apache.org Fri Mar 2 02:23:11 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 3A24A18064D for ; Fri, 2 Mar 2018 02:23:11 +0100 (CET) Received: (qmail 13390 invoked by uid 500); 2 Mar 2018 01:23:10 -0000 Mailing-List: contact dev-help@systemml.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.apache.org Delivered-To: mailing list dev@systemml.apache.org Received: (qmail 13373 invoked by uid 99); 2 Mar 2018 01:23:09 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Mar 2018 01:23:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DF0CD1A07DB for ; Fri, 2 Mar 2018 01:23:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.129 X-Spam-Level: ** X-Spam-Status: No, score=2.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Haz6YuXRMF7J for ; Fri, 2 Mar 2018 01:23:06 +0000 (UTC) Received: from mail-vk0-f53.google.com (mail-vk0-f53.google.com [209.85.213.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 113DC5F260 for ; Fri, 2 Mar 2018 01:23:06 +0000 (UTC) Received: by mail-vk0-f53.google.com with SMTP id s1so4908216vke.5 for ; Thu, 01 Mar 2018 17:23:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Bynm1nFTwacO3ctkYIL7Hwlfmy/5v+9/USwaYwt9Dms=; b=JAtN6wi3lyMLMgoEVO9FkU2bkLcePw7QykJ7gd6/3lM2Z48C2wSqUukG1Ny2Qt6Sc7 bke52N3ElLIXXTieO/C7qeA4GbLYmEsWxxswVGOBlQmGloHfmpaeEo0G6cz4NEhvhiYV LbuwhY2P/jn9AhYjhRBpeO0HEp/BmgqqCJDMHoQNbiB7UJ+5le+qkByTke2K9pjoUNJ+ nO4YtZdWwdiZxMWh8txpLEhm1fL/CrtOJgNQJuOMOOCgMCe9xPWIz+1y8FO/UDUgSoUs WSyU6UPPMuahLj/hV3dUR09jUuSmET7g3Bon8ScBnCxju/5Twhemtkceen8MOc/+O68c 6rsQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Bynm1nFTwacO3ctkYIL7Hwlfmy/5v+9/USwaYwt9Dms=; b=X7hYlyQku/WChmqHwnN8lfBQNkvqSFea9kJjup+6QWxMsI5WN8Ko2zuZ8Z6Va3WEBQ RUh9EDpF7n8Am4McDgcP7tbbj+9kJNn808tUxM/B7U0Bp76Y2M4NELYJ+dJPVe1TTYZv yXLyhkxGjl5XPVtVA77UcOnCpL0/M3vRgh0UR209oD5bh4T10+ZSlqsf9yAQlkqcy26X f/21CoTzKFgN2EskHEKmSV0w6Vf8UKg5hi1ZP0eNGhETk6+pwHFEBVxW9QFKnBnzGbV0 KMnjOOGTx7d4TfDxgulXGsSGjjs21nLT9PO21TmfcPG+oLrmSZwupb50rVLzOxgF37JO PtAw== X-Gm-Message-State: APf1xPDYCJgvBKdwekUX2my/vgElaBIaPpM0Oo7/o9obeWmH6x+xqrDO oIMHa/px3DPCHeo0Gi7VxOrOvvgNuwt0lBkKtTcY X-Google-Smtp-Source: AG47ELvSPRplTnr6uMrUmaMh+2y9jS659BKqVTlIm/L1FA2ohE3DXwvg7YlhTLC3qYKXoP5MeuZHRnCbBn02kNK0Xek= X-Received: by 10.31.63.6 with SMTP id m6mr2972299vka.43.1519953779100; Thu, 01 Mar 2018 17:22:59 -0800 (PST) MIME-Version: 1.0 Received: by 10.176.0.181 with HTTP; Thu, 1 Mar 2018 17:22:58 -0800 (PST) From: Matthias Boehm Date: Thu, 1 Mar 2018 17:22:58 -0800 Message-ID: Subject: Re: Release Planning To: dev@systemml.apache.org Content-Type: multipart/alternative; boundary="001a114dbe5c141064056663d14c" --001a114dbe5c141064056663d14c Content-Type: text/plain; charset="UTF-8" Hi all, I'm sure you've seen that Spark 2.3 just got released. This lines up beautifully with our own SystemML 1.1 release. Accordingly, I would recommend to use Spark 2.3 for our due diligence algorithm-level Q/A. How about we shoot for an RC1 by March 12? This should give enough time to run over reasonably large data and fix all related issues. Regards, Matthias On Tue, Feb 6, 2018 at 12:51 PM, Matthias Boehm wrote: > yes, absolutely. Here is a list of new features and improvements - please > feel free to extend as needed: > > 1) Extended Caffe2DML and Keras2DML APIs > 2) Support for large-dense blocks >16GB in CP > 3) New builtin functions ifelse, xor, as well as and/or/not over matrices > 4) Single-precision support for native conv2d and mm operations. > 5) Performance features and correctness of ultra-sparse operations > 6) Codegen: new plan cache, nary cbind > 7) Parfor: result merge with accumulators +=, reduced initialization > overhead > 8) Compiler improvements: avoid unnecessary spark instructions, corrected > memory estimates > > Until the RC, I'd like to support all deep learning builtin functions in > codegen, add a couple of pending parfor improvements, and potentially do a > first cut of the compiler/runtime integration for parameter servers. > > Regards, > Matthias > > > > On Tue, Feb 6, 2018 at 12:36 PM, Niketan Pansare > wrote: > >> +1. >> >> We should consider including single precision native BLAS in the release >> notes as well. If possible, we should add JNI wrappers for PowerPC, Windows >> and Mac too in this release. >> >> > On Feb 6, 2018, at 12:27 PM, Berthold Reinwald >> wrote: >> > >> > sure. >> > >> > Makes sense. Codegen and Keras2DML made good progress, and many other >> > fixes/improvements. >> > >> > What else do we want time/track/highlight for it? >> > >> > Regards, >> > Berthold Reinwald >> > IBM Almaden Research Center >> > office: (408) 927 2208; T/L: 457 2208 >> > e-mail: reinwald@us.ibm.com >> > >> > >> > >> > From: Matthias Boehm >> > To: dev@systemml.apache.org >> > Date: 02/05/2018 11:05 PM >> > Subject: Release Planning >> > >> > >> > >> > Hi all, >> > >> > since our 1.0 release in Dec, we already got a number enhancements and >> new >> > features in, so I think it would be good to discuss the timeline for our >> > next SystemML 1.1 release. How about, we target mid March for a first >> RC? >> > Also, Berthold would you be willing to serve again as the release >> manager? >> > >> > Regards, >> > Matthias >> > >> > >> > >> > >> >> > --001a114dbe5c141064056663d14c--