hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12466) SparkCounter not initialized error
Date Wed, 25 Nov 2015 02:36:11 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026034#comment-15026034
] 

Chengxiang Li commented on HIVE-12466:
--------------------------------------

Yes, it does, at least at the time i implemented the counter-based stats collection for Spark,
it does not relate to any part of our work on HoS, so i assume it should work just as well
now.

> SparkCounter not initialized error
> ----------------------------------
>
>                 Key: HIVE-12466
>                 URL: https://issues.apache.org/jira/browse/HIVE-12466
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-12466.1-spark.patch
>
>
> During a query, lots of the following error found in executor's log:
> {noformat}
> 03:47:28.759 [Executor task launch worker-0] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_0] has not initialized before.
> 03:47:28.762 [Executor task launch worker-1] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_0] has not initialized before.
> 03:47:30.707 [Executor task launch worker-1] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_1_default.tmp_tmp] has not initialized before.
> 03:47:33.385 [Executor task launch worker-1] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_1_default.test_table] has not initialized before.
> 03:47:33.388 [Executor task launch worker-0] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_1_default.test_table] has not initialized before.
> 03:47:33.495 [Executor task launch worker-0] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_1_default.test_table] has not initialized before.
> 03:47:35.141 [Executor task launch worker-1] ERROR org.apache.hive.spark.counter.SparkCounters
- counter[HIVE, RECORDS_OUT_1_default.test_table] has not initialized before.
> ...........
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message