Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/12729#issuecomment-215962246
Benchmark for Skewness and Kurtosis:
Codes:
test("skewness and kurtosis") {
val N = 50L << 20
runBenchmark("skewness and kurtosis", N) {
sqlContext.range(N).agg(skewness("id"), kurtosis("id")).collect()
}
}
old:
Java HotSpot(TM) 64-Bit Server VM 1.8.0_25-b17 on Linux 3.13.0-57-generic
Westmere E56xx/L56xx/X56xx (Nehalem-C)
skewness and kurtosis: Best/Avg Time(ms) Rate(M/s) Per Row(ns)
Relative
-------------------------------------------------------------------------------------------
skewness and kurtosis codegen=false 10262 / 10996 5.1 195.7
1.0X
skewness and kurtosis codegen=true 3018 / 3209 17.4 57.6
3.4X
new:
Java HotSpot(TM) 64-Bit Server VM 1.8.0_25-b17 on Linux 3.13.0-57-generic
Westmere E56xx/L56xx/X56xx (Nehalem-C)
skewness and kurtosis: Best/Avg Time(ms) Rate(M/s) Per Row(ns)
Relative
-------------------------------------------------------------------------------------------
skewness and kurtosis codegen=false 10328 / 10962 5.1 197.0
1.0X
skewness and kurtosis codegen=true 2751 / 2902 19.1 52.5
3.8X
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
|