spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dongjoon Hyun (JIRA)" <>
Subject [jira] [Created] (SPARK-21846) Reduce the number of shuffle partition in Hive tests
Date Sun, 27 Aug 2017 04:40:00 GMT
Dongjoon Hyun created SPARK-21846:

             Summary: Reduce the number of shuffle partition in Hive tests
                 Key: SPARK-21846
             Project: Spark
          Issue Type: Task
          Components: SQL
    Affects Versions: 2.3.0
            Reporter: Dongjoon Hyun
            Priority: Minor

Currently, Jenkins on master branch fails due to timeout. 

According to the last successful run, Hive tests takes 50 mins from 132 mins (in Java/Scala

org.apache.spark.sql.hive.execution   30 min
org.apache.spark.sql.hive             11 min
org.apache.spark.sql.hive.client       5 min 2 sec
org.apache.spark.sql.hive.orc          1 min 25 sec

This issue aims to reduce the test time by reducing the number of shuffle partitions in Hive

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message