spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiangrui Meng (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-2777) ALS factors should be persist in memory and disk
Date Thu, 31 Jul 2014 20:12:39 GMT
Xiangrui Meng created SPARK-2777:
------------------------------------

             Summary: ALS factors should be persist in memory and disk
                 Key: SPARK-2777
                 URL: https://issues.apache.org/jira/browse/SPARK-2777
             Project: Spark
          Issue Type: Improvement
          Components: MLlib
    Affects Versions: 1.0.0
            Reporter: Xiangrui Meng
            Assignee: Xiangrui Meng


Now the factors are persisted in memory only. If they get kicked off by later jobs, we have
to start the computation from very beginning. A better solution should be changing the storage
level to MEMORY_AND_DISK.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message