Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6042A200C74 for ; Sun, 14 May 2017 08:48:31 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 565BF160BCC; Sun, 14 May 2017 06:48:31 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9C538160BA6 for ; Sun, 14 May 2017 08:48:30 +0200 (CEST) Received: (qmail 81031 invoked by uid 500); 14 May 2017 06:48:29 -0000 Mailing-List: contact dev-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list dev@systemml.incubator.apache.org Received: (qmail 81017 invoked by uid 99); 14 May 2017 06:48:27 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 May 2017 06:48:27 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 1D596C0362 for ; Sun, 14 May 2017 06:48:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.629 X-Spam-Level: ** X-Spam-Status: No, score=2.629 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 716FC-djtuEu for ; Sun, 14 May 2017 06:48:25 +0000 (UTC) Received: from mail-oi0-f49.google.com (mail-oi0-f49.google.com [209.85.218.49]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CA1145F343 for ; Sun, 14 May 2017 06:48:24 +0000 (UTC) Received: by mail-oi0-f49.google.com with SMTP id l18so102437902oig.2 for ; Sat, 13 May 2017 23:48:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=KotW4VLNbJHjP1mU6A/ooRZJbWbPHM2ThhSHozbL+/o=; b=ECq3ROX0wlyKqTuDczcovZlA4dABjmtmv0ZNcrulweos6Pq2ik8XJygeyA7WZYUMAf y9v96ap60b+UGwpyvIahoab6jFzwfd+xYoHu55iKXHoTtcz3YPQ/f/HwGhivxdLjgVE5 6a/q2gzqlObJB/eHzTLxxMw6lC70biq/Qnt1Dv5e8BJzKzVVtascwa+948UHf3gEKZNz 4JclFT9C7yEZp+zBG0Ot4A7V05rqtKMOqu3J2euAN86c3VQi4FuAjG9Q/4R7ry3shZMn G4aE3UT/fC45iidHYKeSci6HICBZYPXYHhnCNt33P1h2iIP4uvkFii+IdrSdl/hpr750 eIww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=KotW4VLNbJHjP1mU6A/ooRZJbWbPHM2ThhSHozbL+/o=; b=TnByd/XyDPc0Kaq7Gy/RzN2mjeub2cmgfQYZ7ag+Whs0zQbJjUrHb5WBx/RR+Gyavx f8NmqSgBOPf12qjSMMdTnBP0XJ3MiayLqkFUwgizB8+u9Es56VHZtxUxvjBFHp9T0XpD s3F/ZD2GguraPLPMh0lfhq7h4jcUl6a+17ZFnCYd2uiRHjdtBUA+QekKUPvxbGGVjuNZ el/WqbyCXDZ+1Y+/jiGz+en9jUcN5XM458CTXq+BrJPvn9UOiegfhhC/4FWxl89fpiEh xpATDpNmv0A+TtzYZ7EfGzdpQFz0ZXTiEnKmTavoxDwDHeEdh5KuO2paQqnduMbaDgWG gJ9Q== X-Gm-Message-State: AODbwcDsfQ/p+lZ5yFSyGuUDWfjji0NKOPd0ZK3fNZwr9KKOiShxnCQi 8BF2Gox911+SWPqUfJ3oR6ZsIlBU6u2k X-Received: by 10.157.44.243 with SMTP id e48mr99972otd.138.1494744503351; Sat, 13 May 2017 23:48:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.15.185 with HTTP; Sat, 13 May 2017 23:47:43 -0700 (PDT) From: Krishna Kalyan Date: Sun, 14 May 2017 02:47:43 -0400 Message-ID: Subject: Some questions on Performance Test To: dev@systemml.incubator.apache.org Content-Type: multipart/alternative; boundary="001a113cff1a26fe01054f76533b" archived-at: Sun, 14 May 2017 06:48:31 -0000 --001a113cff1a26fe01054f76533b Content-Type: text/plain; charset="UTF-8" Hello All, Question 1: Currently we have 5 backend modes. (standalone, hadoop, spark, hybrid and spark_hybrid) I would like to know if we need to have performance tests for all 5 backends + noticed that earlier we had perftests only for MapReduce and Spark Mode. https://github.com/apache/incubator-systemml/tree/master/scripts/perftest Question 2: Would calling scripts from the bin folder to run performance test be a good idea?. https://github.com/apache/incubator-systemml/tree/master/bin (from python files like systemml-standalone.py, systemml-spark-submit.py etc ) Will that be a good approach?. Based on some suggestions on this JIRA, I understand that creating an API would be another option. Please share your thoughts. Regards, Krishna --001a113cff1a26fe01054f76533b--