Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B43B7200C4E for ; Fri, 21 Apr 2017 21:12:15 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B2B8B160B97; Fri, 21 Apr 2017 19:12:15 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CFA78160B86 for ; Fri, 21 Apr 2017 21:12:14 +0200 (CEST) Received: (qmail 88661 invoked by uid 500); 21 Apr 2017 19:12:14 -0000 Mailing-List: contact dev-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list dev@systemml.incubator.apache.org Received: (qmail 88643 invoked by uid 99); 21 Apr 2017 19:12:13 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Apr 2017 19:12:13 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5F784C0631 for ; Fri, 21 Apr 2017 19:12:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.146 X-Spam-Level: X-Spam-Status: No, score=-0.146 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.796, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id QEsEHUWphNX0 for ; Fri, 21 Apr 2017 19:12:11 +0000 (UTC) Received: from mail-oi0-f43.google.com (mail-oi0-f43.google.com [209.85.218.43]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 13B2C5F5C6 for ; Fri, 21 Apr 2017 19:12:11 +0000 (UTC) Received: by mail-oi0-f43.google.com with SMTP id y11so76239794oie.0 for ; Fri, 21 Apr 2017 12:12:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=e1jNhmMUKUHNtR6YFqlsXVQIZ9uKpQQ8UXab+tPFnH4=; b=STxLSuGC6CX8MppfvIl1rm/SbCUwJbN/+uuePPKmTdhW++p6WY8GtfcjVDuhb4Ldcp doD263vqQdrgWHDhWiCahqppwAQjyMA/cMTgzLgDq2KGxJHpDmeD4ybMSm0JVWDmO5hM u9pgyyHPEvsm5qdZ1TJr8Q4zgdkethP13MVxbIjzurf55A92v2s91Q9PPUlo+tEyXSTw pHD8yhR+EEDvmzjJG+lnmPxO0rq8PO7yHIzR/9coTTpSougM6ghEsyw+/LRz4/uC5PbX U/gp1hKlozPQCjaepR/DKX7fqFIZ+2Vq7B8OIweLo7GIFQuhPil7mwUfJ2xsnV9GQNVv aQQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=e1jNhmMUKUHNtR6YFqlsXVQIZ9uKpQQ8UXab+tPFnH4=; b=nqzvrAAvv3cGGjwYd0injG3ynMdTVJJu0EnGL5S9puG5FCu5EC8g4MzSLX1mt3Ap4W 2HUpiE+7Ja2d+EGNg8ZrTVgGvDU09Sua3goYaF1I+jpQnDHH0E8X2Ybu6fYP/21CR6rm Q0TXWl5M6MKV+CV9j+uY0L2v1kdUnKK3tC6TCSGNTPCAs8uiZnSANUK4J1XknNSMQCkY 1VKH0hcnD+ciVFsOS4FTVlUTGgN2Sul9nqkfWPexVLnQS5EM2ZAYGCzwHLe4zCLEudcF qNSRec3cuN+9x+evqT9TuLpGzvqAau59FsCW+J7dUnNkLpBV/VXd0qdFCU/pV8iZPoD6 /JQA== X-Gm-Message-State: AN3rC/6mIl6ppvRcXEGVyPNbEwonnAJF3b4Qs7V0GN1q1bfEgyqmjrDP Soqw25P5qYSzoIhBJDsXXtHak9aikCqAslw= X-Received: by 10.202.51.9 with SMTP id z9mr8277266oiz.25.1492801930347; Fri, 21 Apr 2017 12:12:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.15.104 with HTTP; Fri, 21 Apr 2017 12:11:29 -0700 (PDT) In-Reply-To: References: <478828078.668005.1492797613376@mail.yahoo.com> From: Krishna Kalyan Date: Fri, 21 Apr 2017 15:11:29 -0400 Message-ID: Subject: Re: GSoC : Getting started contributions To: dev@systemml.incubator.apache.org Cc: Arvind Surve Content-Type: multipart/alternative; boundary=001a113cf4dec7574d054db20886 archived-at: Fri, 21 Apr 2017 19:12:15 -0000 --001a113cf4dec7574d054db20886 Content-Type: text/plain; charset=UTF-8 Thanks Nakul, Arvind and Matthias for your suggestions. I am currently playing around with System-ML, will also take a look at SYSTEMML-546 + plan to run some performance tests on my local system this weekend. Regards, Krishna On Fri, Apr 21, 2017 at 3:04 PM, Nakul Jindal wrote: > Hi Krishna, > > What Arvind is describing is in essence a large part of you GSoC proposal. > You should work on this if and when your proposal gets approved. (we don't > know whether it has been approved and even if we did, we couldn't say). > In the meantime, I encourage you to play around with SystemML, go through > the JIRA site, (look at SYSTEMML-546 as Matthias suggested) and ask > questions on this mailing list that you may have. > > Thanks, > Nakul > > > On Fri, Apr 21, 2017 at 11:00 AM, Arvind Surve > wrote: > > > Hi Krishna, > > There is immediate need for SystemML project to run performance testing > > and analyze results efficiently.Though this is small part of your overall > > GSoC project, its important to start with it and grow from there.In short > > term it will help SystemML project to expedite release cycles and in long > > run you will get head start on the project. > > What we need for short run to get performance testing for every release > > cycle or even beyond. 1. How to setup environment with configurable > > parameters quickly. (We have scripts may need some tweaking or some > > additional configuration) 2. Run performance scripts with configuration > > option of Data size (8GB, 80GB, 8000GB etc or ALL), Different set of > > algorithms regression, classification or all 3. Collect time required > to > > run individual algorithm for a given size. and store it in CSV or any > > suitable format file for further processing. 4. Compare results > obtained > > from step 3 to previous runs (previous release, RC etc) 5. Generate > > report indicating, Failures scenarios, Outliers (time taken was more than > > tolerance level (say x%), and Successful cases. Each to be > separated > > out so that reading those reports will be easy. > > > > Arvind Surve | Spark Technology Center | http://www.spark.tc/ > > > > From: Matthias Boehm > > To: dev@systemml.incubator.apache.org > > Sent: Saturday, April 15, 2017 3:27 PM > > Subject: Re: GSoC : Getting started contributions > > > > A great issue to start with would be SYSTEMML-546, which aims to cleanup > > and extend our existing application tests. This would get you in touch > with > > DML and PyDML algorithm scripts as well as the R scripts for comparisons. > > > > Regards, > > Matthias > > > > On Sat, Apr 15, 2017 at 2:58 PM, Krishna Kalyan < > krishnakalyan3@gmail.com> > > wrote: > > > > > Hello, > > > I quite recently applied for GSoC. (Proposal below) [ Automate > > performance > > > testing and reporting] > > > > > > https://docs.google.com/document/d/1DKWZTWvrvs73GYa1q3XEN5GFo8ALG > > > jLH2DrIfRsJksA/edit# > > > > > > As part of my effort to understand the codebase, I would like to work > on > > > minor/medium issues. Could someone from the community please guide with > > > JIRAs I could work on during my spare time. > > > (I am comfortable with Python, R and bash). > > > > > > Regards, > > > Krishna > > > > > > > > > > > > --001a113cf4dec7574d054db20886--