flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2221) Checkpoints to "file://" are not cleaned up
Date Mon, 15 Jun 2015 14:37:01 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586119#comment-14586119
] 

Ufuk Celebi commented on FLINK-2221:
------------------------------------

@Marton: how are you fixing this? Check and retry with a different name?

I think it is a valid use case to do the checkpoints on the local FS. I will sync with [~StephanEwen]
and look into this later.

> Checkpoints to "file://" are not cleaned up
> -------------------------------------------
>
>                 Key: FLINK-2221
>                 URL: https://issues.apache.org/jira/browse/FLINK-2221
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Aljoscha Krettek
>
> If you think about it, this could never work. The state handle cleanup logic happens
purely on the JobManager. So what happens is that the TaskManagers create state in some directory,
let's say /tmp/checkpoints, on the TaskManager. For cleanup, the JobManager gets the state
handle and calls discard (on the JobManager), this tries to cleanup the state in /tmp/checkpoints,
but of course, there is nothing there since we are still on the JobManager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message