batchee-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Struberg (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BATCHEE-37) provide a CheckpointAlgorithm which can be set from the ItemReader or Processor
Date Sat, 10 May 2014 22:06:09 GMT
Mark Struberg created BATCHEE-37:
------------------------------------

             Summary: provide a CheckpointAlgorithm which can be set from the ItemReader or
Processor
                 Key: BATCHEE-37
                 URL: https://issues.apache.org/jira/browse/BATCHEE-37
             Project: BatchEE
          Issue Type: New Feature
          Components: batchee-extensions
    Affects Versions: 0.1-incubating
            Reporter: Mark Struberg


We have a batch which has a huge amount of work to do. Usually this batch processes in a day-by-day
manner which means that we cannot use a fixed item-count and we need a custom CheckpointAlgorithm.

The problem with CheckpointAlgorithm is that it doesn't have any info about the data it processes.
So what about supplying a CheckpointAlgorithm which uses a @StepScoped holder which just contains
a boolean. This might then be either set by the ItemReader or ItemProcessor to signal that
a certain point is reached and the chunk shall be committed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message