spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-6278][MLLIB] Mention the change of objective in linear regression
Date Fri, 13 Mar 2015 17:27:31 GMT
Repository: spark
Updated Branches:
  refs/heads/master dc4abd4dc -> 7f13434a5

[SPARK-6278][MLLIB] Mention the change of objective in linear regression

As discussed in the RC3 vote thread, we should mention the change of objective in linear regression
in the migration guide. srowen

Author: Xiangrui Meng <>

Closes #4978 from mengxr/SPARK-6278 and squashes the following commits:

fb3bbe6 [Xiangrui Meng] mention regularization parameter
bfd6cff [Xiangrui Meng] Merge remote-tracking branch 'apache/master' into SPARK-6278
375fd09 [Xiangrui Meng] address Sean's comments
f87ae71 [Xiangrui Meng] mention step size change


Branch: refs/heads/master
Commit: 7f13434a5c52b815c584ec773ab0e5df1a35ea86
Parents: dc4abd4
Author: Xiangrui Meng <>
Authored: Fri Mar 13 10:27:28 2015 -0700
Committer: Xiangrui Meng <>
Committed: Fri Mar 13 10:27:28 2015 -0700

 docs/ | 2 ++
 1 file changed, 2 insertions(+)
diff --git a/docs/ b/docs/
index 598374f..f8e8794 100644
--- a/docs/
+++ b/docs/
@@ -102,6 +102,8 @@ In the `spark.mllib` package, there were several breaking changes.  The
first ch
     * In `DecisionTree`, the deprecated class method `train` has been removed.  (The object/static
`train` methods remain.)
     * In `Strategy`, the `checkpointDir` parameter has been removed.  Checkpointing is still
supported, but the checkpoint directory must be set before calling tree and tree ensemble
 * `PythonMLlibAPI` (the interface between Scala/Java and Python for MLlib) was a public API
but is now private, declared `private[python]`.  This was never meant for external use.
+* In linear regression (including Lasso and ridge regression), the squared loss is now divided
by 2.
+  So in order to produce the same result as in 1.2, the regularization parameter needs to
be divided by 2 and the step size needs to be multiplied by 2.
 ## Previous Spark Versions

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message