batchee-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Romain Manni-Bucau (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BATCHEE-37) provide a CheckpointAlgorithm which can be set from the ItemReader or Processor
Date Mon, 12 May 2014 09:49:14 GMT

    [ https://issues.apache.org/jira/browse/BATCHEE-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994969#comment-13994969
] 

Romain Manni-Bucau commented on BATCHEE-37:
-------------------------------------------

Hi

I'd provide it without any scope in extras (JavaSE) then with a scope if you want in a cdi
module.

wdyt?

> provide a CheckpointAlgorithm which can be set from the ItemReader or Processor
> -------------------------------------------------------------------------------
>
>                 Key: BATCHEE-37
>                 URL: https://issues.apache.org/jira/browse/BATCHEE-37
>             Project: BatchEE
>          Issue Type: New Feature
>          Components: batchee-extensions
>    Affects Versions: 0.1-incubating
>            Reporter: Mark Struberg
>
> We have a batch which has a huge amount of work to do. Usually this batch processes in
a day-by-day manner which means that we cannot use a fixed item-count and we need a custom
CheckpointAlgorithm.
> The problem with CheckpointAlgorithm is that it doesn't have any info about the data
it processes. So what about supplying a CheckpointAlgorithm which uses a @StepScoped holder
which just contains a boolean. This might then be either set by the ItemReader or ItemProcessor
to signal that a certain point is reached and the chunk shall be committed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message