spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Genmao Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-18116) spark streaming ui show 0 events when recovering from checkpoint
Date Fri, 20 Jan 2017 07:46:26 GMT

     [ https://issues.apache.org/jira/browse/SPARK-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Genmao Yu updated SPARK-18116:
------------------------------
    Fix Version/s: 2.1.1
                   2.0.3

> spark streaming ui show 0 events when recovering from checkpoint
> ----------------------------------------------------------------
>
>                 Key: SPARK-18116
>                 URL: https://issues.apache.org/jira/browse/SPARK-18116
>             Project: Spark
>          Issue Type: Bug
>          Components: DStreams
>    Affects Versions: 1.6.1
>         Environment: jdk1.8.0_77  Red Hat 4.4.7-11
>            Reporter: liujianhui
>            Priority: Minor
>             Fix For: 2.0.3, 2.1.1
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> run a streaming application which souce from kafka.There are many batchs queued in the
job list before application stopped, and then stop the application, as follow starting it
from checkpointed file, in the spark ui, the size of the queued batchs which stored in the
checkpoint file are 0
> Batch Time	Input Size	Scheduling Delay (?) 	Processing Time (?) 	Total Delay (?) 	Output
Ops: Succeeded/Total
> 2016/10/26 19:02:15 	0 events	1.1 h 	13 s 	1.1 h 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message