manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lalit jangra <lalit.j.jan...@gmail.com>
Subject Reconciliation of documents crawled
Date Tue, 16 Sep 2014 04:54:56 GMT
Greetings ,

As part of implementation, i need to put a reconciliation mechanism in
place where it can be verified how many documents have been crawled for a
job and same can be displayed in logs.

First thing came into my mind is to put counters in e.g. CMIS connector
code in addSeed() and proecessDocuments() methods and increase it as we
progress but as i could see for CMIS that CmisRepositoryConnector.java is
getting called for each seeded document to be ingested, these counters are
not accurate. Is there any method where i can persist these counters within
code itself as i do not want to persist them in file system.

Please suggest.
-- 
Regards,
Lalit.

Mime
View raw message