flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-4430) prevent BLOCKING partition data lose when task is finished
Date Fri, 19 Aug 2016 10:07:20 GMT

     [ https://issues.apache.org/jira/browse/FLINK-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Stephan Ewen updated FLINK-4430:
    Priority: Major  (was: Minor)

> prevent BLOCKING partition data lose when task is finished
> ----------------------------------------------------------
>                 Key: FLINK-4430
>                 URL: https://issues.apache.org/jira/browse/FLINK-4430
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Cluster Management
>            Reporter: Kurt Young
> When we have a BLOCKING result partition type, the data is actually holded by TaskManager,
not the slot. When we finish the produce task, we will mark this task finished and try to
release the slot. Under the new architecture, with yarn or mesos mode, releasing slot may
trigger releasing the container, so the TaskManager will be terminated, thus the result data
is lost. We should introduce some mechanism to prevent this from happening.

This message was sent by Atlassian JIRA

View raw message