lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mohan, Sowmya" <>
Subject RE: CachedSqlEntityProcessor with delta-import
Date Mon, 24 Oct 2016 20:02:13 GMT
Thanks James. That's what I was using before. But I also wanted to perform deletes using deletedPkQuery
and hence switched to delta imports. The problem with using deletedPkQuery with the full import
is that dataimporter.last_index_time is no longer accurate. 

Below is an example of my deletedPkQuery. If run the full-import for a differential index,
that would update the last index time. Running the delta import to remove the deleted records
then wouldn't do anything since nothing changed since the last index time. 

 deletedPkQuery="SELECT id
			FROM content
			WHERE active = 1 AND lastUpdate > '${dataimporter.last_index_time}'"

-----Original Message-----
From: Dyer, James [] 
Sent: Friday, October 21, 2016 4:23 PM
Subject: RE: CachedSqlEntityProcessor with delta-import


My memory is that the cache feature does not work with Delta Imports.  In fact, I believe
that nearly all DIH features except straight JDBC imports do not work with Delta Imports.
 My advice is to not use the Delta Import feature at all as the same result can (often more-efficiently)
be accomplished following the approach outlined here:

James Dyer
Ingram Content Group

-----Original Message-----
From: Mohan, Sowmya [] 
Sent: Tuesday, October 18, 2016 10:07 AM
Subject: CachedSqlEntityProcessor with delta-import

Good morning,

Can CachedSqlEntityProcessor be used with delta-import? In my setup when running a delta-import
with CachedSqlEntityProcessor, the child entity values are not correctly updated for the parent
record. I am on Solr 4.3. Has anyone experienced this and if so how to resolve it?


View raw message