beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-312) UnboundedSourceWrapper fails if CheckpointMarkCoder not available
Date Sat, 28 May 2016 14:13:12 GMT
Maximilian Michels created BEAM-312:
---------------------------------------

             Summary: UnboundedSourceWrapper fails if CheckpointMarkCoder not available
                 Key: BEAM-312
                 URL: https://issues.apache.org/jira/browse/BEAM-312
             Project: Beam
          Issue Type: Bug
          Components: runner-flink
    Affects Versions: 0.1.0-incubating
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
             Fix For: 0.1.0-incubating


The Flink Runner's UnboundedSourceWrapper does not check whether the CheckpointMarkCoder is
null. In this case, no checkpoint is required by the wrapped source.

{noformat}
  /**
   * Returns a {@link Coder} for encoding and decoding the checkpoints for this source, or
   * null if the checkpoints do not need to be durably committed.
   */
  @Nullable
  public abstract Coder<CheckpointMarkT> getCheckpointMarkCoder();
{noformat}

We should skip checkpointing if no CheckpointMarkCoder is supplied.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message