spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yu Ishikawa <yuu.ishikawa+sp...@gmail.com>
Subject [mllib] Share the simple benchmark result about the cast cost from Spark vector to Breeze vector
Date Wed, 15 Oct 2014 14:05:33 GMT
Hi all,

I wondered the cast cost from Spark Vectors to Breeze vector is high or low. 
So I benchmarked the simple operation about addition, multiplication and 
division of RDD[Vector] or RDD[BV[Double]]. I share the simple benchmark
result with you.

In conclusion, the cast cost was lower than I had expected. 
For more information, please read the below report, if you are interested in
it.
https://github.com/yu-iskw/benchmark-breeze-on-spark/blob/master/doc%2Fbenchmark-result.md

Best,
Yu Ishikawa



-----
-- Yu Ishikawa
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/mllib-Share-the-simple-benchmark-result-about-the-cast-cost-from-Spark-vector-to-Breeze-vector-tp8793.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message