spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chengning (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-22424) Task not finished for a long time in monitor UI, but I found it finished in logs
Date Thu, 02 Nov 2017 08:32:03 GMT

    [ https://issues.apache.org/jira/browse/SPARK-22424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235384#comment-16235384
] 

chengning edited comment on SPARK-22424 at 11/2/17 8:31 AM:
------------------------------------------------------------


sorry, my picture not display, I post it again.
[^1.jpg]


was (Author: chengning):
!1.jpg|thumbnail!   
sorry, my picture not display, I post it again.

> Task not finished for a long time in monitor UI, but I found it finished in logs
> --------------------------------------------------------------------------------
>
>                 Key: SPARK-22424
>                 URL: https://issues.apache.org/jira/browse/SPARK-22424
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.1.0
>            Reporter: chengning
>            Priority: Blocking
>         Attachments: 1.jpg, 1.png, C33oL.jpg
>
>
> Task not finished for a long time in monitor UI, but I found it finished in logs
> Thanks a lot.
> !https://i.stack.imgur.com/C33oL.jpg!
> !C33oL.jpg|thumbnail!
> executor log:
> 17/09/29 17:32:28 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 213492
> 17/09/29 17:32:28 INFO executor.Executor: Running task 52.0 in stage 2468.0 (TID 213492)
> 17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Getting 30 non-empty blocks
out of 30 blocks
> 17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Started 29 remote fetches
in 1 ms
> 17:32:28.447: tcPartition=7 ms
> 17/09/29 17:32:28 INFO executor.Executor: Finished task 52.0 in stage 2468.0 (TID 213492).
2755 bytes result sent to driver
> driver logļ¼š:
> 17/09/29 17:32:28 INFO scheduler.TaskSetManager: Starting task 52.0 in stage 2468.0 (TID
213492, HMGQXD2, executor 1, partition 52, PROCESS_LOCAL, 6386 bytes)
> 17/09/29 17:32:28 INFO scheduler.TaskSetManager: Finished task 52.0 in stage 2468.0 (TID
213492) in 24 ms on HMGQXD2 (executor 1) (53/200)
> 17/09/29 17:32:28 INFO cluster.YarnScheduler: Removed TaskSet 2468.0, whose tasks have
all completed, from pool 
> 17/09/29 17:32:28 INFO scheduler.DAGScheduler: ResultStage 2468 (foreachPartition at
Counter2.java:152) finished in 0.255 s
> 17/09/29 17:32:28 INFO scheduler.DAGScheduler: Job 1647 finished: foreachPartition at
Counter2.java:152, took 0.415256 s



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message