spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Pentreath (JIRA)" <>
Subject [jira] [Commented] (SPARK-15575) Remove breeze from dependencies?
Date Fri, 27 May 2016 18:49:12 GMT


Nick Pentreath commented on SPARK-15575:

What specifically are the "performance issues" with Breeze as it stands currently?

> Remove breeze from dependencies?
> --------------------------------
>                 Key: SPARK-15575
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>            Reporter: Joseph K. Bradley
> This JIRA is for discussing whether we should remove Breeze from the dependencies of
MLlib.  The main issues with Breeze are Scala 2.12 support and performance issues.
> There are a few paths:
> # Keep dependency.  This could be OK, especially if the Scala version issues are fixed
within Breeze.
> # Remove dependency
> ## Implement our own linear algebra operators as needed
> ## Design a way to build Spark using custom linalg libraries of the user's choice.  E.g.,
you could build MLlib using Breeze, or any other library supporting the required operations.
 This might require significant work.  See [SPARK-6442] for related discussion.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message