lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shalin Shekhar Mangar <>
Subject Re: How to handle database replication delay when using DataImportHandler?
Date Fri, 30 Jan 2009 09:45:48 GMT
On Fri, Jan 30, 2009 at 12:27 AM, Gregg Donovan <> wrote:

> Noble,
> Thanks for the suggestion. The unfortunate thing is that we really don't
> know ahead of time what sort of replication delay we're going to encounter
> -- it could be one millisecond or it could be one hour. So, we end up
> needing to do something like:
> For delta-import run N:
> 1. query DB slave for "seconds_behind_master", use this to calculate
> Date(N).
> 2. query DB slave for records updated since Date(N - 1)
> I see there are plugin points for EventListener classes (onImportStart,
> onImportEnd). Would those be the right spot to calculate these dates so
> that
> I could expose them to my custom function at query time?

Unfortunately, the Context object (which carries the context information and
way to pass messages to other components) is not exposed to Evaluator. We
should expose this information to be consistent with other DIH components.

I've opened an issue to track this at

Shalin Shekhar Mangar.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message