Return-Path: X-Original-To: apmail-systemml-dev-archive@minotaur.apache.org Delivered-To: apmail-systemml-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 62362184B0 for ; Tue, 8 Dec 2015 03:29:45 +0000 (UTC) Received: (qmail 55594 invoked by uid 500); 8 Dec 2015 03:29:45 -0000 Delivered-To: apmail-systemml-dev-archive@systemml.apache.org Received: (qmail 55547 invoked by uid 500); 8 Dec 2015 03:29:45 -0000 Mailing-List: contact dev-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list dev@systemml.incubator.apache.org Received: (qmail 55535 invoked by uid 99); 8 Dec 2015 03:29:45 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Dec 2015 03:29:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 708FCC2830 for ; Tue, 8 Dec 2015 03:29:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.13 X-Spam-Level: *** X-Spam-Status: No, score=3.13 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id uouu2qo0-Ni2 for ; Tue, 8 Dec 2015 03:29:38 +0000 (UTC) Received: from mail-wm0-f54.google.com (mail-wm0-f54.google.com [74.125.82.54]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id B5E0B44536 for ; Tue, 8 Dec 2015 03:29:37 +0000 (UTC) Received: by wmww144 with SMTP id w144so12865556wmw.0 for ; Mon, 07 Dec 2015 19:29:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=NrXgoy6O7GBIWFfqyTQDQ58dHcTPXiu/KpufF/cT8U8=; b=gOXCL31g1i3JUa9pHaga4QIUrlFuUxibScIBPXVwZuiGAa7WKFCsMbrlPTXvn2qKoj lzTMmSSmwgdiO2fZ32fwr1dNIInnycf3DqUs+9bCderqi+E8+8pKrSkoQ0mfFtXYr3TX Jj6yepM0SMoAvlpS19YFUZ9myr988Ye3mlJfizgC8fYpo1s+2/J4/Kk1fB4qIhyxJJso U9TsyQABP/jj6w/8KjsJT7Nn9BW2f/FLVE17S29a0gfJ8qR/VSuuDGghVna/eWr+xlBP L2tVJaF3ALJnD/Do45f77fARhYl+JeRkTPYABsZStXtrgJQqFojQZB3Hdx83aIQak/nC xUEQ== MIME-Version: 1.0 X-Received: by 10.194.82.229 with SMTP id l5mr1325504wjy.140.1449545376958; Mon, 07 Dec 2015 19:29:36 -0800 (PST) Received: by 10.194.163.1 with HTTP; Mon, 7 Dec 2015 19:29:36 -0800 (PST) Date: Mon, 7 Dec 2015 19:29:36 -0800 Message-ID: Subject: Using GLM with Spark From: Sourav Mazumder To: dev@systemml.incubator.apache.org Content-Type: multipart/alternative; boundary=047d7bb03f4047900f05265a955b --047d7bb03f4047900f05265a955b Content-Type: text/plain; charset=UTF-8 Hi, Trying to use GLM with Spark. I go through the documentation of the same in http://apache.github.io/incubator-systemml/algorithms-regression.html#generalized-linear-models I see that inputs like X and Y have to supplied using a file and the file has to be there in HDFS. Is this understanding correct ? Can't X and Y be supplied using a Data Frame from a Spark Context (as in case of example of LinearRegression in http://apache.github.io/incubator-systemml/mlcontext-programming-guide.html#train-using-systemml-linear-regression-algorithm) ? Regards, Sourav --047d7bb03f4047900f05265a955b--