spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From viirya <...@git.apache.org>
Subject [GitHub] spark pull request: [SPARK-14951][SQL] Support subexpression elimi...
Date Sat, 30 Apr 2016 13:08:04 GMT
Github user viirya commented on the pull request:

    https://github.com/apache/spark/pull/12729#issuecomment-215962246
  
    Benchmark for Skewness and Kurtosis:
    
    Codes:
    
        test("skewness and kurtosis") {
          val N = 50L << 20
          runBenchmark("skewness and kurtosis", N) {
            sqlContext.range(N).agg(skewness("id"), kurtosis("id")).collect()
          }
        }
    
    
    old:
    
        Java HotSpot(TM) 64-Bit Server VM 1.8.0_25-b17 on Linux 3.13.0-57-generic
        Westmere E56xx/L56xx/X56xx (Nehalem-C)
        skewness and kurtosis:              Best/Avg Time(ms)    Rate(M/s)   Per Row(ns) 
 Relative
        -------------------------------------------------------------------------------------------
        skewness and kurtosis codegen=false    10262 / 10996          5.1         195.7  
    1.0X
        skewness and kurtosis codegen=true       3018 / 3209         17.4          57.6  
    3.4X
    
    
    new:
    
        Java HotSpot(TM) 64-Bit Server VM 1.8.0_25-b17 on Linux 3.13.0-57-generic
        Westmere E56xx/L56xx/X56xx (Nehalem-C)
        skewness and kurtosis:              Best/Avg Time(ms)    Rate(M/s)   Per Row(ns) 
 Relative
        -------------------------------------------------------------------------------------------
        skewness and kurtosis codegen=false    10328 / 10962          5.1         197.0  
    1.0X
        skewness and kurtosis codegen=true       2751 / 2902         19.1          52.5  
    3.8X



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message