beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rafal Wojdyla (JIRA)" <>
Subject [jira] [Created] (BEAM-1458) Checkpoint support in beam
Date Fri, 10 Feb 2017 15:58:41 GMT
Rafal Wojdyla created BEAM-1458:

             Summary: Checkpoint support in beam
                 Key: BEAM-1458
             Project: Beam
          Issue Type: Improvement
          Components: beam-model
    Affects Versions: 0.5.0
            Reporter: Rafal Wojdyla
            Assignee: Rafal Wojdyla

Beam could support checkpoints - similar to:
 * flink's snapshots
 * scalding's checkpoints

Checkpoint should provides a simple mechanism to read and write intermediate results. It would
be useful for debugging one part of a long flow, when you would otherwise have to run many
steps to get to the one you care about.

This message was sent by Atlassian JIRA

View raw message