flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3250) Savepoint coordinator requires too strict parallelism match
Date Mon, 18 Jan 2016 12:55:39 GMT
Ufuk Celebi created FLINK-3250:

             Summary: Savepoint coordinator requires too strict parallelism match
                 Key: FLINK-3250
                 URL: https://issues.apache.org/jira/browse/FLINK-3250
             Project: Flink
          Issue Type: Bug
          Components: Distributed Runtime
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi
             Fix For: 1.0.0

The savepoint coordinator requires that the number of collected states of an operator and
the parallelism of the new job (the one to be restored) match exactly. This is too strict.

For example a Kafka source with parallelism 2 and a single Kafka partition does not collect
state for one of the two sources (hence it is not part of the savepoint state). Currently,
restoring the same job with the same parallelism fails, which should not happen.

This message was sent by Atlassian JIRA

View raw message