spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yh...@apache.org
Subject spark git commit: [SPARK-14871][SQL] Disable StatsReportListener to declutter output
Date Sat, 23 Apr 2016 19:42:42 GMT
Repository: spark
Updated Branches:
  refs/heads/master ee6b209a9 -> fddd3aee0


[SPARK-14871][SQL] Disable StatsReportListener to declutter output

## What changes were proposed in this pull request?
Spark SQL inherited from Shark to use the StatsReportListener. Unfortunately this clutters
the spark-sql CLI output and makes it very difficult to read the actual query results.

## How was this patch tested?
Built and tested in spark-sql CLI.

Author: Reynold Xin <rxin@databricks.com>

Closes #12635 from rxin/SPARK-14871.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fddd3aee
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fddd3aee
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/fddd3aee

Branch: refs/heads/master
Commit: fddd3aee0df2cf2244780ce81c370ff3863bb65c
Parents: ee6b209
Author: Reynold Xin <rxin@databricks.com>
Authored: Sat Apr 23 12:42:37 2016 -0700
Committer: Yin Huai <yhuai@databricks.com>
Committed: Sat Apr 23 12:42:37 2016 -0700

----------------------------------------------------------------------
 .../scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala | 2 --
 1 file changed, 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/fddd3aee/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala
----------------------------------------------------------------------
diff --git a/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala
b/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala
index 465457f..a44b0d3 100644
--- a/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala
+++ b/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala
@@ -23,7 +23,6 @@ import scala.collection.JavaConverters._
 
 import org.apache.spark.{SparkConf, SparkContext}
 import org.apache.spark.internal.Logging
-import org.apache.spark.scheduler.StatsReportListener
 import org.apache.spark.sql.hive.{HiveContext, HiveUtils}
 import org.apache.spark.util.Utils
 
@@ -55,7 +54,6 @@ private[hive] object SparkSQLEnv extends Logging {
           maybeKryoReferenceTracking.getOrElse("false"))
 
       sparkContext = new SparkContext(sparkConf)
-      sparkContext.addSparkListener(new StatsReportListener())
       hiveContext = new HiveContext(sparkContext)
 
       hiveContext.sessionState.metadataHive.setOut(new PrintStream(System.out, true, "UTF-8"))


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message