hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-10060) Provide more informative stage description in Spark Web UI [Spark Branch]
Date Mon, 23 Mar 2015 17:59:52 GMT
Chao created HIVE-10060:
---------------------------

             Summary: Provide more informative stage description in Spark Web UI [Spark Branch]
                 Key: HIVE-10060
                 URL: https://issues.apache.org/jira/browse/HIVE-10060
             Project: Hive
          Issue Type: Sub-task
          Components: spark-branch
    Affects Versions: 1.2.0
            Reporter: Chao
            Priority: Minor


Currently, for HoS in Spark Web UI, it displays stage information like the following:

Description:
foreachAsync at RemoteHiveSparkClient.java:254
org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45)
org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:254)
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:366)

It would be better to provide more useful information, like what is the part of the query
that this stage is about. Looks like this is implemented in SparkSQL.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message