spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From r...@apache.org
Subject [2/2] git commit: Merge pull request #273 from rxin/top
Date Wed, 18 Dec 2013 06:26:31 GMT
Merge pull request #273 from rxin/top

Fixed a performance problem in RDD.top and BoundedPriorityQueue

BoundedPriority was actually traversing the entire queue to calculate the size, resulting
in bad performance in insertion.

This should also cherry pick cleanly into branch-0.8.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/f4effb37
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/f4effb37
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/f4effb37

Branch: refs/heads/master
Commit: f4effb375e93993be1777ebb423c100ea8422f24
Parents: 7a8169b 9a6864d
Author: Reynold Xin <rxin@apache.org>
Authored: Tue Dec 17 22:26:21 2013 -0800
Committer: Reynold Xin <rxin@apache.org>
Committed: Tue Dec 17 22:26:21 2013 -0800

----------------------------------------------------------------------
 .../main/scala/org/apache/spark/util/BoundedPriorityQueue.scala    | 2 ++
 1 file changed, 2 insertions(+)
----------------------------------------------------------------------



Mime
View raw message