Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 21 Sep 2015 15:18:04 +0000 (UTC)
From: "Xiangrui Meng (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.12854242.1439321667000.28080.1442848684107@Atlassian.JIRA>
In-Reply-To: <JIRA.12854242.1439321667000@Atlassian.JIRA>
References: <JIRA.12854242.1439321667000@Atlassian.JIRA>
 <JIRA.12854242.1439321667871@arcas>
Subject: [jira] [Commented] (SPARK-9836) Provide R-like summary statistics
 for ordinary least squares via normal equation solver
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/SPARK-9836?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1490=
0802#comment-14900802 ]=20

Xiangrui Meng commented on SPARK-9836:
--------------------------------------

This JIRA is still blocked by SPARK-10668. If you are a first-time contribu=
tor, I would recommend taking a starter task: https://issues.apache.org/jir=
a/issues/?filter=3D12333209.

> Provide R-like summary statistics for ordinary least squares via normal e=
quation solver
> -------------------------------------------------------------------------=
--------------
>
>                 Key: SPARK-9836
>                 URL: https://issues.apache.org/jira/browse/SPARK-9836
>             Project: Spark
>          Issue Type: Sub-task
>          Components: ML
>            Reporter: Xiangrui Meng
>
> In R, model fitting comes with summary statistics. We can provide most of=
 those via normal equation solver (SPARK-9834). If some statistics requires=
 additional passes to the dataset, we can expose an option to let users sel=
ect desired statistics before model fitting.=20
> {code}
> > summary(model)
> Call:
> glm(formula =3D Sepal.Length ~ Sepal.Width + Species, data =3D iris)
> Deviance Residuals:=20
>      Min        1Q    Median        3Q       Max =20
> -1.30711  -0.25713  -0.05325   0.19542   1.41253 =20
> Coefficients:
>                   Estimate Std. Error t value Pr(>|t|)   =20
> (Intercept)         2.2514     0.3698   6.089 9.57e-09 ***
> Sepal.Width         0.8036     0.1063   7.557 4.19e-12 ***
> Speciesversicolor   1.4587     0.1121  13.012  < 2e-16 ***
> Speciesvirginica    1.9468     0.1000  19.465  < 2e-16 ***
> ---
> Signif. codes: =20
> 0 =E2=80=98***=E2=80=99 0.001 =E2=80=98**=E2=80=99 0.01 =E2=80=98*=E2=80=
=99 0.05 =E2=80=98.=E2=80=99 0.1 =E2=80=98 =E2=80=99 1
> (Dispersion parameter for gaussian family taken to be 0.1918059)
>     Null deviance: 102.168  on 149  degrees of freedom
> Residual deviance:  28.004  on 146  degrees of freedom
> AIC: 183.94
> Number of Fisher Scoring iterations: 2
> {code}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org