From dev-return-2318-archive-asf-public=cust-asf.ponee.io@systemml.apache.org Mon Jan 29 05:01:51 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 3E84918064F for ; Mon, 29 Jan 2018 05:01:51 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2E677160C52; Mon, 29 Jan 2018 04:01:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4D9BE160C43 for ; Mon, 29 Jan 2018 05:01:50 +0100 (CET) Received: (qmail 74047 invoked by uid 500); 29 Jan 2018 04:01:49 -0000 Mailing-List: contact dev-help@systemml.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.apache.org Delivered-To: mailing list dev@systemml.apache.org Received: (qmail 74033 invoked by uid 99); 29 Jan 2018 04:01:48 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jan 2018 04:01:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 4D9DA180160 for ; Mon, 29 Jan 2018 04:01:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.129 X-Spam-Level: *** X-Spam-Status: No, score=3.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 6yjhJ4sJYTGA for ; Mon, 29 Jan 2018 04:01:45 +0000 (UTC) Received: from mail-qk0-f182.google.com (mail-qk0-f182.google.com [209.85.220.182]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 6500E5F6C3 for ; Mon, 29 Jan 2018 04:01:45 +0000 (UTC) Received: by mail-qk0-f182.google.com with SMTP id c69so3954543qkg.6 for ; Sun, 28 Jan 2018 20:01:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=kv48LFj1ckGm3UReGQUmGqWRaOIohKWY7KJ3D9Vxt4M=; b=X3lJYmBuWf2MCHz4B72eIaq5uHFd2LGkH/RpvbL2PGdtQujwNNFK33RKc3fwm//2wE EeMvNIOoqBP28roTfybSlf0b0uIicKGRqZr24NKDjWMHTMMRRIBlMpP2efTP37iV3W0g G+l+wLxjW6eZ9BOfY0zenDxt30PPFc7ZoN/EW0bVTl8lCPam1Q9PmDTydvLLG5oU2FUG 27Dvbczts6zg19lJty6OgGdMD1ow4+TFqZg/dl1xwFA5tvgoiWswwWk5ER4TeCI8Yv4n qMAVdxtlxHBFIFm9/2A7cyBTlK9LjK6q//EhWzEQ2BawYlUGyB4zLUv9NDkuc4osV65e RMFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=kv48LFj1ckGm3UReGQUmGqWRaOIohKWY7KJ3D9Vxt4M=; b=bjXJ/iXQ5N19/FmRQVwEE6Fa49I4Ln8GHbm7vjCkmr7CjqsEFGta4shlWbE9DpOApK XDqWqH1RZYbq5hZqmDhhpu7YdQethRpug4Srquc7ClMVcxGhB2HA2GUOhRvStoGsbLiQ jvmN5X2eiHV5okVaqCW651M4WSezPQ8DkPFp7ounHET5yNmmkZTpP0uGPbDUksvOC87X xSl1yRhL1psxKObK0hmLhhJoageMR2RTm+bKMPj9/gMdUERwcx7l4WXyBbAGQLRQnPAY xuBz+hSTxn7HAZWjRduXvlJ1rJnPUJGRzrOaA1mhmGKv+KIElOWHIzvh+ihxNi/p2DnO g0/A== X-Gm-Message-State: AKwxyteM6Shmq18Sq4mfpiomRcnjGhMmnfa+izdaiTlfbUn2nDtrbFml An8/pAjGew9EULxw5PQpFj9LkEmPLtHRk5AxKwGniXK9 X-Google-Smtp-Source: AH8x226k8idlM1UYmOiGPQayrIpEIIQ7YEWiIM4bOYfZPhQLCnqrI2jXYTNJtdDVnwesDNwqD6MCH9pf0Y0ayeIDFvw= X-Received: by 10.55.77.80 with SMTP id a77mr31716812qkb.239.1517198504700; Sun, 28 Jan 2018 20:01:44 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.42.99 with HTTP; Sun, 28 Jan 2018 20:01:23 -0800 (PST) In-Reply-To: <3790D587-432D-4F24-AD04-00C28C3F6DDE@gmail.com> References: <3790D587-432D-4F24-AD04-00C28C3F6DDE@gmail.com> From: Nakul Jindal Date: Sun, 28 Jan 2018 20:01:23 -0800 Message-ID: Subject: Re: [Discuss] GSoC 2018 To: dev@systemml.apache.org Content-Type: multipart/alternative; boundary="001a114a7152ed31940563e24dc5" --001a114a7152ed31940563e24dc5 Content-Type: text/plain; charset="UTF-8" Hi Himanshu, Per the rules of GSoC, you can apply if you are currently enrolled in a "accredited institution, including a college, university, masters program, PhD program and/or undergraduate program, as of the Acceptance Date". https://summerofcode.withgoogle.com/rules/ If you are, we'd be delighted to have you apply. Even if you are not a student, it'd be awesome if you could contribute to any of the projects. Take a look at some of the straggler PRs that Krishna mentioned on this thread. -Nakul On Sun, Jan 28, 2018 at 7:12 PM, Himanshu Mohan wrote: > Hi, > I like to participate or contribute in this in any way possible . I am > working as Tech architect in AMEX with 14 yrs of tech experience . > > Thanks and Regards > Himanshu > > > On 28-Jan-2018, at 2:11 PM, Krishna Kalyan > wrote: > > > > Hello Matthias and Nakul, > > 4 more ideas that could be included. > > > > [Perftest] > > - Compare runtime System-ML to Julia, R, Sklearn, Spark MLLib based on > data > > gen scripts. > > - Prepare report with all the information about failed jobs, performance > > information, perf info against other comparable projects/algorithms > > (plotted/in plain text in CSV, PDF or another common format) > > - Create a simple web application (Shiny / Heroku that can display these > > statistics) > > https://issues.apache.org/jira/browse/SYSTEMML-1451 > > > > [XGBoost] > > It would be great to have XGBoost > > https://issues.apache.org/jira/browse/SYSTEMML-978 > > https://issues.apache.org/jira/browse/SYSTEMML-822 > > > > [ADAM W] > > https://issues.apache.org/jira/browse/SYSTEMML-2018 > > fast ai library has this fix already implemented > > https://github.com/fastai/fastai/pull/46 > > > > [Straggler PRs] > > - Add unit test > > - Improve documentation > > - Add more notebooks and examples > > - Complete all easy/medium pending PRs > > - Functionalize all algorithms > > https://github.com/apache/systemml/pull/200 > > https://github.com/apache/systemml/pull/589 > > https://github.com/apache/systemml/pull/613 > > > > If it looks good, then I can create/ add these issues with gsoc2018 > label. > > > > Regards, > > Krishna > > > > > > > > > >> On Sun, Jan 28, 2018 at 3:53 AM, Matthias Boehm > wrote: > >> > >> yes, but we as mentors will help out as needed, especially on the > initial > >> language and compiler integration. Furthermore, it's a rather scalable > >> project in the sense that it could also accommodate multiple students. > For > >> example, the different backends are fairly independent sub-projects. > >> > >> Regards, > >> Matthias > >> > >>> On Sat, Jan 27, 2018 at 1:57 PM, Nakul Jindal > wrote: > >>> > >>> This is awesome! > >>> I am guessing the goal is to have this epic be a summer worth of > >>> mini-projects for a single GSoC student, isthat correct? > >>> > >>> > >>> > >>> On Fri, Jan 26, 2018 at 7:46 PM, Matthias Boehm > >> wrote: > >>> > >>>> just FYI: I've created https://issues.apache.org/ > >>> jira/browse/SYSTEMML-2083 > >>>> with the gsoc2018 label. If you have additional project ideas, please > >>> file > >>>> the respective JIRAs. Thanks. > >>>> > >>>> Regards, > >>>> Matthias > >>>> > >>>> On Mon, Jan 22, 2018 at 12:13 AM, Matthias Boehm > >>>> wrote: > >>>> > >>>>> yes, that is a good idea and we should leverage this opportunity. I'm > >>>>> happy to mentor a project as well, specifically on parameter server > >>>>> architectures for distributed deep learning in SystemML. > >>>>> > >>>>> Right now we can emulate synchronous parameter servers with parfor, > >> but > >>>>> there are other architectures like asynchronous, stale-synchronous, > >>>>> heterogeneity-aware, and decentralized, which we should support as > >> well > >>>> in > >>>>> form of a dedicated runtime infrastructure similar to local/remote > >>>> parfor. > >>>>> If done right, we should be able to leverage common primitives in > >>> parfor > >>>>> and these parameter servers. > >>>>> > >>>>> Apart from better support for distributed deep learning, this would > >>> bring > >>>>> us much closer to the goal of a unified framework for large-scale > >>> machine > >>>>> learning as we would be the only framework that supports > >> data-parallel > >>>>> (distributed ops), task-parallel (parfor), and model-parallel > >>> (parameter > >>>>> server) execution strategies in a single system. > >>>>> > >>>>> I'll create an epic with sub tasks later this week. The goal would be > >>> to > >>>>> integrate these parameter servers with the underlying data-parallel > >>>>> framework to have a common runtime for distributed operations and > >>>>> automatically support all underlying resource schedulers such as > >> YARN, > >>>>> Mesos, and Kubernetes. Since the project is relatively large, we > >> might > >>>> need > >>>>> to split it up into multiple GSoC projects along with multiple > >> mentors. > >>>>> > >>>>> Regards, > >>>>> Matthias > >>>>> > >>>>>> On 1/22/2018 8:53 AM, Nakul Jindal wrote: > >>>>>> > >>>>>> Hi Krishna, > >>>>>> > >>>>>> That is a great idea. Thank you for offering to be a > >> mentor/co-mentor. > >>>>>> I suggest that you think of a list of projects that you can mentor, > >>>>>> discuss > >>>>>> them on the mailing list and we can add them as JIRAs with the > >>>> appropriate > >>>>>> tags (as required by Apache). > >>>>>> > >>>>>> If there are students on this mailing list who want to suggest a > >>> topic, > >>>>>> that is very welcome too. If a mentor is willing to take it on, they > >>>> will > >>>>>> respond either here or on a JIRA. > >>>>>> > >>>>>> -Nakul > >>>>>> > >>>>>> > >>>>>> > >>>>>> On Sun, Jan 21, 2018 at 9:49 PM, Krishna Kalyan < > >>>> krishnakalyan3@gmail.com > >>>>>>> > >>>>>> wrote: > >>>>>> > >>>>>> Hello All, > >>>>>>> I was wondering if system-ml community was planning to participate > >> in > >>>>>>> GSoC > >>>>>>> this year. I had a wonderful time last year and learned a lot!. > >>>>>>> > >>>>>>> If we could have a couple of JIRAS for GSoC 2018 it would be > >> great. I > >>>> am > >>>>>>> willing to help out as a mentor/ co-mentor if that is a bottleneck. > >>>>>>> > >>>>>>> > >>>>>>> [1] GSoC Website (https://summerofcode.withgoogle.com/) > >>>>>>> [2] GSoC Time Line (https://developers.google. > >>>>>>> com/open-source/gsoc/timeline) > >>>>>>> [3] GSoC 2017 JIRA (https://issues.apache.org/ > >>>> jira/browse/SYSTEMML-1451) > >>>>>>> > >>>>>>> Regards, > >>>>>>> Krishna > >>>>>>> > >>>>>>> > >>>>>> > >>>> > >>> > >> > --001a114a7152ed31940563e24dc5--