lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uomesh <Uom...@gmail.com>
Subject Re: Solr 4.2 - Slave Index version is higher than Master
Date Thu, 28 Mar 2013 15:05:00 GMT
Yes, Only thing is, on master delta import is running every 1/2 hour but as
there is no data change in last 24 hour i think index version still remains
same. another thing i notice is after full import index Gen is bumped to
directly higher than slave. Can that means Master is not increasing Version
and Gen with delta-import correctly? See as below.

*Before Full Import*

Master:
1364331607690
154
88.28 KB
Slave:
1364395321127
241
98.75 KB

*After Full Import*
Master:
1364395566324
242
88.28 KB
Slave:
1364395321127
241
98.75 KB

On Tue, Mar 26, 2013 at 1:05 PM, Mark Miller-3 [via Lucene] <
ml-node+s472066n4051477h11@n3.nabble.com> wrote:

> That's pretty interesting. The slave should have no way of doing this
> without a commit…
>
> - Mark
>
> On Mar 26, 2013, at 11:07 AM, Uomesh <[hidden email]<http://user/SendEmail.jtp?type=node&node=4051477&i=0>>
> wrote:
>
> > Hi Mark,
> >
> > Further details: My master details has not changed since last 24 hours
> but
> > Slave index version and Gen has increased. If i do the full import slave
> > is replicated and Version and Gen is reset.
> >               Version               GenSize
> > Master:
> > 1364238678758
> > 111
> > 768.23 KB
> > Slave:
> > 1364299206396
> > 155
> > 768.02 KB
> >
> >
> >
> > On Fri, Mar 22, 2013 at 3:32 PM, Mark Miller-3 [via Lucene] <
> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4051477&i=1>>
> wrote:
> >
> >> That was to you Phil.
> >>
> >> So it seems this is a problem with the configuration replication case I
> >> would guess - I didn't really look at that path in the 4.2 fixes I
> worked
> >> on.
> >>
> >> I did add it to the new testing I'm doing since I've suspected it (it
> will
> >> prompt a core reload that doesn't happen when configs don't replicate).
> >> I'll see what I can do to try and get a test to catch it.
> >>
> >> - mark
> >>
> >> On Mar 22, 2013, at 1:49 PM, Mark Miller <[hidden email]<
> http://user/SendEmail.jtp?type=node&node=4050577&i=0>>
> >> wrote:
> >>
> >>> And your also on 4.2?
> >>>
> >>> - Mark
> >>>
> >>> On Mar 22, 2013, at 12:41 PM, Uomesh <[hidden email]<
> http://user/SendEmail.jtp?type=node&node=4050577&i=1>>
> >> wrote:
> >>>
> >>>> Also, I am replicating only on commit and startup.
> >>>>
> >>>> Thanks,
> >>>> Umesh
> >>>>
> >>>> On Fri, Mar 22, 2013 at 11:23 AM, Umesh Sharma <[hidden email]<
> http://user/SendEmail.jtp?type=node&node=4050577&i=2>>
> >> wrote:
> >>>>
> >>>>> Hi Mrk,
> >>>>>
> >>>>> I am replicating below config files but not replicating
> >> solrconfig.xml.
> >>>>>
> >>>>> confFiles: schema.xml, elevate.xml, stopwords.txt,
> >>>>> mapping-FoldToASCII.txt, mapping-ISOLatin1Accent.txt, protwords.txt,
> >>>>> spellings.txt, synonyms.txt
> >>>>>
> >>>>>
> >>>>> also strange I am seeing big Gen difference between Master and
> slave.
> >> My
> >>>>> master slave is 2 while Slave is 56. If i do the full import then
> the
> >> Gen
> >>>>> is getting higher then slave one and its replicating. i have more
> than
> >> 30
> >>>>> cores on my solr instance and all are scheduled to replicate on
same
> >> time.
> >>>>>
> >>>>> Index Version Gen Size Master:
> >>>>> 1363903243590
> >>>>> 2
> >>>>> 94 bytes
> >>>>> Slave:
> >>>>> 1363967579193
> >>>>> 56
> >>>>> 94 bytes
> >>>>>
> >>>>> Thanks,
> >>>>> Umesh
> >>>>>
> >>>>>
> >>>>> On Fri, Mar 22, 2013 at 10:42 AM, Mark Miller-3 [via Lucene] <
> >>>>> [hidden email] <http://user/SendEmail.jtp?type=node&node=4050577&i=3>>
>
> >> wrote:
> >>>>>
> >>>>>> Are you replicating configuration files as well?
> >>>>>>
> >>>>>> - Mark
> >>>>>>
> >>>>>> On Mar 22, 2013, at 6:38 AM, "John, Phil (CSS)" <[hidden
email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=0>>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> To add to the discussion.
> >>>>>>>
> >>>>>>> We're running classic master/slave replication (not solrcloud)
> with
> >> 1
> >>>>>> master and 2 slaves and I noticed the slave having a higher
version
> >> number
> >>>>>> than the master the other day as well.
> >>>>>>>
> >>>>>>> In our case, knock on wood, it hasn't stopped replication.
> >>>>>>>
> >>>>>>> If you'd like a copy of our config I can provide off-list.
> >>>>>>>
> >>>>>>> Regards,
> >>>>>>>
> >>>>>>> Phil.
> >>>>>>>
> >>>>>>> ________________________________
> >>>>>>>
> >>>>>>> From: Mark Miller [mailto:[hidden email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=1>]
> >>>>>>
> >>>>>>> Sent: Fri 22/03/2013 06:32
> >>>>>>> To: [hidden email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=2>
> >>>>>>> Subject: Re: Solr 4.2 - Slave Index version is higher than
Master
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> The other odd thing here is that this should not stop replication
> at
> >>>>>> all. When the slave is ahead, it will still have it's index
> replaced.
> >>>>>>>
> >>>>>>> - Mark
> >>>>>>>
> >>>>>>> On Mar 22, 2013, at 1:26 AM, Mark Miller <[hidden email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=3>>
> >>>>>> wrote:
> >>>>>>>
> >>>>>>>> I'm working on testing to try and catch what you are
seeing here:
> >>>>>> https://issues.apache.org/jira/browse/SOLR-4629
> >>>>>>>>
> >>>>>>>> - Mark
> >>>>>>>>
> >>>>>>>> On Mar 22, 2013, at 12:23 AM, Mark Miller <[hidden
email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=4>>
> >>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Let me know if there is anything else you can add.
> >>>>>>>>>
> >>>>>>>>> A test with your setup that index n docs randomly,
commits,
> >> randomly
> >>>>>> updates a conf file or not, and then replicates and repeats
x times
> >> does
> >>>>>> not seem to fail, even with very high values for n and x. On
every
> >>>>>> replication, the versions are compared.
> >>>>>>>>>
> >>>>>>>>> Is there anything else you are putting into this
mix?
> >>>>>>>>>
> >>>>>>>>> - Mark
> >>>>>>>>>
> >>>>>>>>> On Mar 21, 2013, at 11:28 PM, Uomesh <[hidden
email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=5>>
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Thank you!!,
> >>>>>>>>>>
> >>>>>>>>>> Attached is my master solrconfig.xml. I have
few custom
> handlers
> >>>>>> which you
> >>>>>>>>>> might need to remove. In custom handler i have
not much code
> just
> >>>>>> adding
> >>>>>>>>>> some custom data for UI.
> >>>>>>>>>>
> >>>>>>>>>> Thanks,
> >>>>>>>>>> Umesh
> >>>>>>>>>>
> >>>>>>>>>> On Thu, Mar 21, 2013 at 9:59 PM, Mark Miller-3
[via Lucene]
> >>>>>>>>>> <[hidden email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=6>
> >>>>>>>>>> mible.com <[hidden email]<
> >> http://user/SendEmail.jtp?type=node&node=4050075&i=7>>>
> >>>>>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>> Could you attach the master as well?
> >>>>>>>>>>>
> >>>>>>>>>>> - Mark
> >>>>>>>>>>>
> >>>>>>>>>>> On Mar 21, 2013, at 4:36 PM, Uomesh <[hidden
email]<
> >>>>>> http://user/SendEmail.jtp?type=node&node=4049933&i=0>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> Hi Mark,
> >>>>>>>>>>>>
> >>>>>>>>>>>> Attached is my solrconfig_slave.xml.
My replication interval
> is
> >> 1
> >>>>>>>>>>>> minute(default).
> >>>>>>>>>>>>
> >>>>>>>>>>>> Please let me know if you need any more
config details
> >>>>>>>>>>>>
> >>>>>>>>>>>> Thanks,
> >>>>>>>>>>>> umesh
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Thu, Mar 21, 2013 at 3:19 PM, Mark
Miller-3 [via Lucene] <
> >>>>>>>>>>>> [hidden email] <
> >>>>>> http://user/SendEmail.jtp?type=node&node=4049933&i=1>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> Can you give more details about
your configuration and
> setup?
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Our best bet is to try and recreate
this with a unit test.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> - Mark
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Mar 21, 2013, at 4:08 PM, Uomesh
<[hidden email]<
> >>>>>>>>>>> http://user/SendEmail.jtp?type=node&node=4049832&i=0>>
> >>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Hi,
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> I am seeing an issue after upgrading
from solr 3.6.2 to
> Solr
> >>>>>> 4.2. My
> >>>>>>>>>>>>> Slave
> >>>>>>>>>>>>>> stop replicating after sometime.
And it seems issue is
> >> because
> >>>>>> of my
> >>>>>>>>>>>>> Slave
> >>>>>>>>>>>>>> Index version is higher than
master. How could it be
> possible
> >> to
> >>>>>> Slave
> >>>>>>>>>>>>> Index
> >>>>>>>>>>>>>> version is higher than master?
Please help me. IS there
> >> anything
> >>>>>> i
> >>>>>>>>>>> need
> >>>>>>>>>>>>> to
> >>>>>>>>>>>>>> remove from my slave solrconfig.xml.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Index Version Gen Size
> >>>>>>>>>>>>>> Master: 1363893820575 93 8.75
MB
> >>>>>>>>>>>>>> Slave: 1363896006624 94 8.75
MB
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks,
> >>>>>>>>>>>>>> Umesh
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> --
> >>>>>>>>>>>>>> View this message in context:
> >>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827.html
> >>>>>>>>>>>>>> Sent from the Solr - User mailing
list archive at
> Nabble.com.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> ------------------------------
> >>>>>>>>>>>>> If you reply to this email, your
message will be added to
> the
> >>>>>>>>>>> discussion
> >>>>>>>>>>>>> below:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049832.html
> >>>>>>>>>>>>> To unsubscribe from Solr 4.2 - Slave
Index version is higher
> >> than
> >>>>>>>>>>> Master, click
> >>>>>>>>>>>>> here<
> >>>>>>>>>>>>> .
> >>>>>>>>>>>>> NAML<
> >>>>>>>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> >>
> >>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> solrconfig_slave.xml (67K) <
> >>>>>>>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/attachment/4049840/0/solrconfig_slave.xml>
>
> >>
> >>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> --
> >>>>>>>>>>>> View this message in context:
> >>>>>>>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049840.html
> >>>>>>>>>>>
> >>>>>>>>>>>> Sent from the Solr - User mailing list
archive at Nabble.com.
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> ------------------------------
> >>>>>>>>>>> If you reply to this email, your message
will be added to the
> >>>>>> discussion
> >>>>>>>>>>> below:
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049933.html
> >>>>>>>>>>> To unsubscribe from Solr 4.2 - Slave Index
version is higher
> >> than
> >>>>>> Master, click
> >>>>>>>>>>> here<
> >>>>>>>>>>> .
> >>>>>>>>>>> NAML<
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> >>
> >>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> solrconfig.xml (74K) <
> >>>>>>
> >> http://lucene.472066.n3.nabble.com/attachment/4049934/0/solrconfig.xml>
>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>> View this message in context:
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049934.html
> >>>>>>>>>> Sent from the Solr - User mailing list archive
at Nabble.com.
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> ------------------------------
> >>>>>> If you reply to this email, your message will be added to the
> >>>>>> discussion below:
> >>>>>>
> >>>>>>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4050075.html
> >>>>>> To unsubscribe from Solr 4.2 - Slave Index version is higher
than
> >>>>>> Master, click here<
> >>>>>> .
> >>>>>> NAML<
> >>
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> >>
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> View this message in context:
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4050463.html
> >>>> Sent from the Solr - User mailing list archive at Nabble.com.
> >>>
> >>
> >>
> >>
> >> ------------------------------
> >> If you reply to this email, your message will be added to the
> discussion
> >> below:
> >>
> >>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4050577.html
> >> To unsubscribe from Solr 4.2 - Slave Index version is higher than
> Master, click
> >> here<
> >> .
> >> NAML<
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> >>
> >
> >
> >
> >
> > --
> > View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4051430.html
>
> > Sent from the Solr - User mailing list archive at Nabble.com.
>
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4051477.html
>  To unsubscribe from Solr 4.2 - Slave Index version is higher than Master, click
> here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4049827&code=VW9tZXNoQGdtYWlsLmNvbXw0MDQ5ODI3fDIyODkyODYxMg==>
> .
> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4052071.html
Sent from the Solr - User mailing list archive at Nabble.com.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message