camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From swwyatt <>
Subject GenericFileConsumer - Idempotent and InProgress repositories
Date Thu, 09 May 2013 18:05:04 GMT
The implementations of the GenericFileConsumer (FileConsumer,
SftpConsumer,...) method, pollDirectory(), make calls to isValidFile() and
if that returns true, calls isInProgress(). This process fails when there
are multiple processes polling. For example when process P0 calls
isValidFile() and the idempotent repository does not have the file entry, it
then calls isInProgress(). But, if process P1, who is in progress for the
file, commits to the idempotent repository and subsequently releases its
entry in the in progress repository, then P0 may obtain an in progress
status and process a file that is now in the idempotent repository.

Should the isInProgress() call be made before the isValidFile() call? This
may have additional overhead of checking the in progress repository, but the
chance for duplicate processing would be removed.

View this message in context:
Sent from the Camel - Users mailing list archive at

View raw message