spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From m...@apache.org
Subject git commit: [SPARK-3226][MLLIB] doc update for native libraries
Date Tue, 26 Aug 2014 22:12:34 GMT
Repository: spark
Updated Branches:
  refs/heads/master 6b5584ef1 -> adbd5c163


[SPARK-3226][MLLIB] doc update for native libraries

to mention `-Pnetlib-lgpl` option. atalwalkar

Author: Xiangrui Meng <meng@databricks.com>

Closes #2128 from mengxr/mllib-native and squashes the following commits:

4cbba57 [Xiangrui Meng] update mllib dependencies


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/adbd5c16
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/adbd5c16
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/adbd5c16

Branch: refs/heads/master
Commit: adbd5c1636669fc474ab02b54cd1ced353f68712
Parents: 6b5584e
Author: Xiangrui Meng <meng@databricks.com>
Authored: Tue Aug 26 15:12:27 2014 -0700
Committer: Xiangrui Meng <meng@databricks.com>
Committed: Tue Aug 26 15:12:27 2014 -0700

----------------------------------------------------------------------
 docs/mllib-guide.md | 25 +++++++++++++++----------
 1 file changed, 15 insertions(+), 10 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/adbd5c16/docs/mllib-guide.md
----------------------------------------------------------------------
diff --git a/docs/mllib-guide.md b/docs/mllib-guide.md
index ca0a84a..4d4198b 100644
--- a/docs/mllib-guide.md
+++ b/docs/mllib-guide.md
@@ -35,18 +35,23 @@ and the migration guide below will explain all changes between releases.
 
 # Dependencies
 
-MLlib uses the linear algebra package [Breeze](http://www.scalanlp.org/), which depends on
-[netlib-java](https://github.com/fommil/netlib-java), and
-[jblas](https://github.com/mikiobraun/jblas). 
+MLlib uses the linear algebra package [Breeze](http://www.scalanlp.org/),
+which depends on [netlib-java](https://github.com/fommil/netlib-java),
+and [jblas](https://github.com/mikiobraun/jblas). 
 `netlib-java` and `jblas` depend on native Fortran routines.
 You need to install the
-[gfortran runtime library](https://github.com/mikiobraun/jblas/wiki/Missing-Libraries) if
it is not
-already present on your nodes. MLlib will throw a linking error if it cannot detect these
libraries
-automatically.  Due to license issues, we do not include `netlib-java`'s native libraries
in MLlib's
-dependency set. If no native library is available at runtime, you will see a warning message.
 To
-use native libraries from `netlib-java`, please include artifact
-`com.github.fommil.netlib:all:1.1.2` as a dependency of your project or build your own (see
-[instructions](https://github.com/fommil/netlib-java/blob/master/README.md#machine-optimised-system-libraries)).
+[gfortran runtime library](https://github.com/mikiobraun/jblas/wiki/Missing-Libraries)
+if it is not already present on your nodes.
+MLlib will throw a linking error if it cannot detect these libraries automatically.
+Due to license issues, we do not include `netlib-java`'s native libraries in MLlib's
+dependency set under default settings.
+If no native library is available at runtime, you will see a warning message.
+To use native libraries from `netlib-java`, please build Spark with `-Pnetlib-lgpl` or
+include `com.github.fommil.netlib:all:1.1.2` as a dependency of your project.
+If you want to use optimized BLAS/LAPACK libraries such as
+[OpenBLAS](http://www.openblas.net/), please link its shared libraries to
+`/usr/lib/libblas.so.3` and `/usr/lib/liblapack.so.3`, respectively.
+BLAS/LAPACK libraries on worker nodes should be built without multithreading.
 
 To use MLlib in Python, you will need [NumPy](http://www.numpy.org) version 1.4 or newer.
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message