lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paras Lehana <paras.leh...@indiamart.com>
Subject Re: Replication Iteration
Date Thu, 12 Sep 2019 13:15:38 GMT
Hey Akreeti,

<str name="commitReserveDuration">00:00:10</str>


Have you tried increasing *commitReserveDuration*? Do you have any idea how
much time your successful replications take for 2.62 GB?



On Wed, 11 Sep 2019 at 22:30, Akreeti Agarwal <AkreetiA@hcl.com> wrote:

> Hi,
>
> It fails many times, sharing the iteration:
>
> Passed:
> Wed Sep 11 16:49:18 UTC 2019
> Wed Sep 11 16:48:56 UTC 2019
> Wed Sep 11 16:48:36 UTC 2019
> Wed Sep 11 16:48:18 UTC 2019
> Wed Sep 11 16:47:55 UTC 2019
> Wed Sep 11 16:47:35 UTC 2019
> Wed Sep 11 16:47:16 UTC 2019
> Wed Sep 11 16:46:55 UTC 2019
> Wed Sep 11 16:46:33 UTC 2019
>
> Failed:
> Wed Sep 11 16:42:47 UTC 2019
> Wed Sep 11 16:36:07 UTC 2019
> Wed Sep 11 16:32:47 UTC 2019
> Wed Sep 11 16:29:27 UTC 2019
> Wed Sep 11 16:24:27 UTC 2019
> Wed Sep 11 16:11:07 UTC 2019
> Wed Sep 11 16:09:47 UTC 2019
> Wed Sep 11 16:05:47 UTC 2019
> Wed Sep 11 15:53:27 UTC 2019
> Wed Sep 11 15:51:47 UTC 2019
>
> Memory details:
>
>              total       used       free     shared    buffers     cached
> Mem:         15947      15549        398         62        198       5650
> -/+ buffers/cache:       9700       6246
> Swap:            0          0          0
>
>
> Thanks & Regards,
> Akreeti Agarwal
>
>
> -----Original Message-----
> From: Jon Kjær Amundsen <ja@udbudsvagten.dk>
> Sent: Wednesday, September 11, 2019 7:28 PM
> To: solr-user@lucene.apache.org
> Subject: Re: Replication Iteration
>
> Is it every time it fails, or just sometimes?
> What is the timestamps on the failed and passed iterations?
> And how much disk space do you have available on the slave?
>
> Venlig hilsen/Best regards
>
> *Jon Kjær Amundsen*
> Developer
>
>
> Phone: +45 7023 9080
> E-mail: ja@udbudsvagten.dk
> Web:
> https://apc01.safelinks.protection.outlook.com/?url=www.udbudsvagten.dk&amp;data=02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c019bb%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&amp;sdata=DSWnCimBzOilM8DoS4efsbgE%2BP%2BG2RDP0IUjolch7Z4%3D&amp;reserved=0
> Parken - Tårn D - 5. Sal
> Øster Allé 48 | DK - 2100 København
>
> <
> https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdk.linkedin.com%2Fin%2FJonKjaerAmundsen%2F&amp;data=02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c019bb%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&amp;sdata=84xwmZ%2BEj6u9sXiSmM7QMKHpkDMpYMpltFNhKT6v7F0%3D&amp;reserved=0
> >
>
> Intelligent Offentlig Samhandel
> *Før, under og efter udbud*
>
> *Følg UdbudsVagten og markedet her Linkedin <
> https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.linkedin.com%2Fgroups%3FgroupDashboard%3D%26gid%3D1862353&amp;data=02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c019bb%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&amp;sdata=pFZ%2FUDSmCzzuUJur74FMF9%2FDXSCKkJHCs8x4Wj3Jyfo%3D&amp;reserved=0>
> *
>
>
> Den ons. 11. sep. 2019 kl. 15.23 skrev Akreeti Agarwal <AkreetiA@hcl.com>:
>
> > My index size is 2.62 GB, and :
> > <str name="commitReserveDuration">00:00:10</str>
> >
> > Thanks & Regards,
> > Akreeti Agarwal
> >
> >
> > -----Original Message-----
> > From: Paras Lehana <paras.lehana@indiamart.com>
> > Sent: Wednesday, September 11, 2019 5:39 PM
> > To: solr-user@lucene.apache.org
> > Subject: Re: Replication Iteration
> >
> > What is the size of your index? Is it too big? How fast is your link
> > between master and slave?
> >
> > I'm asking these because, for larger indexes, you may want to raise
> > commitReserveDuration defined in ReplicationHandler in solrconfig.xml.
> >
> > <str name="commitReserveDuration">00:00:10</str>
> >
> >
> > From SolrReplication
> > <
> > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwik
> > i.apache.org%2Fconfluence%2Fdisplay%2Fsolr%2FSolrReplication&amp;data=
> > 02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c019bb%7C189d
> > e737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&amp;sdata=4p
> > rY6X8%2FXVTbFj9OAlgQ1t6Vq7GFytRPHNzPsQkFktc%3D&amp;reserved=0
> > >
> > documentation for Master
> > <
> > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwik
> > i.apache.org%2Fconfluence%2Fdisplay%2Fsolr%2FSolrReplication%23Master&
> > amp;data=02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c019
> > bb%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&amp
> > ;sdata=vPlsIvqTrwzq0wSkBkMiJc3C7IOaXpQWdwG06xRlG9k%3D&amp;reserved=0
> > >:
> >
> > If your commits are very frequent and network is particularly slow,
> > you can
> > > tweak an extra attribute <str
> > name="commitReserveDuration">00:00:10</str>.
> > > This is roughly the time taken to download 5MB from master to slave.
> > > Default is 10 secs.
> >
> >
> >  Do check the hyperlinks.
> >
> > On Wed, 11 Sep 2019 at 17:25, Akreeti Agarwal <AkreetiA@hcl.com> wrote:
> >
> > > I am seeing the logs on both UI and file, but I only see this error:
> > >
> > > ReplicationHandler
> > > Index fetch failed :org.apache.solr.common.SolrException: Unable to
> > > download segments_znow completely. Downloaded 0!=2217
> > >
> > > Thanks & Regards,
> > > Akreeti Agarwal
> > >
> > > -----Original Message-----
> > > From: Paras Lehana <paras.lehana@indiamart.com>
> > > Sent: Wednesday, September 11, 2019 5:17 PM
> > > To: solr-user@lucene.apache.org
> > > Subject: Re: Replication Iteration
> > >
> > > Hi Akreeti,
> > >
> > > Have you tried using the old UI to see errors? I had always
> > > experienced not seeing status updates about replication in the newer
> > > UI. Check for the option on top right of Solr UI.
> > >
> > > And where are you seeing logs - on solr UI or from a file?
> > >
> > > On Wed, 11 Sep 2019 at 16:12, Akreeti Agarwal <AkreetiA@hcl.com>
> wrote:
> > >
> > > > In the logs I don't see any errors, mostly after every  1-2 min
> > > > replication fails and I am not able to identify the root cause for
> it.
> > > >
> > > > Thanks & Regards,
> > > > Akreeti Agarwal
> > > >
> > > > -----Original Message-----
> > > > From: Jon Kjær Amundsen <ja@udbudsvagten.dk>
> > > > Sent: Wednesday, September 11, 2019 12:15 PM
> > > > To: solr-user@lucene.apache.org
> > > > Subject: Re: Replication Iteration
> > > >
> > > > It depends on the timestamps.
> > > > The red iterations are failed replications and the green are
> > > > passed replications.
> > > > If the newest timestamp is green the latest replication went well,
> > > > if it is red, it failed.
> > > >
> > > > You should check the solr log on the slave if a recent replication
> > > > have failed to see the cause.
> > > >
> > > > Venlig hilsen/Best regards
> > > >
> > > > *Jon Kjær Amundsen*
> > > > Developer
> > > >
> > > >
> > > > Phone: +45 7023 9080
> > > > E-mail: ja@udbudsvagten.dk
> > > > Web:
> > > > www.udbudsvagten
> > > > .d
> > > > k&amp;data=02%7C01%7CAkreetiA%40hcl.com%7Cdac98a88d43446d88f8208d7
> > > > 36
> > > > ad
> > > > ebfa%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C1%7C6370379929316514
> > > > 16
> > > > &a
> > > > mp;sdata=HBrEXexrQZ2UrhmDwGaZfnvn4XjbawVGq8PnMDA5ocA%3D&amp;reserv
> > > > ed
> > > > =0
> > > > Parken - Tårn D - 5. Sal
> > > > Øster Allé 48 | DK - 2100 København
> > > >
> > > > <
> > > > http://dk.
> > > > li
> > > > nkedin.com%2Fin%2FJonKjaerAmundsen%2F&amp;data=02%7C01%7CAkreetiA%
> > > > 40
> > > > hc
> > > > l.com%7Cdac98a88d43446d88f8208d736adebfa%7C189de737c93a4f5a8b686f4
> > > > ca
> > > > 99
> > > > 41912%7C0%7C1%7C637037992931651416&amp;sdata=9sealYl8sRN7Et2Oc%2F8
> > > > Nx
> > > > nx
> > > > ooisjC15hPV5y9NSCgKg%3D&amp;reserved=0
> > > > >
> > > >
> > > > Intelligent Offentlig Samhandel
> > > > *Før, under og efter udbud*
> > > >
> > > > *Følg UdbudsVagten og markedet her Linkedin < http://www .l
> > > > inkedin.com%2Fgroups%3FgroupDashboard%3D%26gid%3D1862353&amp;data=
> > > > 02
> > > > %7
> > > > C01%7CAkreetiA%40hcl.com%7Cdac98a88d43446d88f8208d736adebfa%7C189d
> > > > e7
> > > > 37
> > > > c93a4f5a8b686f4ca9941912%7C0%7C1%7C637037992931651416&amp;sdata=zQ
> > > > VT
> > > > %2 FJjMY6GlU4IVHZEMc6P4EWh9MrMcWEybBonKn7w%3D&amp;reserved=0>
> > > > *
> > > >
> > > >
> > > > Den ons. 11. sep. 2019 kl. 06.35 skrev Akreeti Agarwal
> > > ><AkreetiA@hcl.com
> > > >:
> > > >
> > > > > Hi All,
> > > > >
> > > > > I am using solr-5.5.5, in which I have one master and two slaves.
> > > > > I see some red and some green replication iteration on my slave
> side.
> > > > > What does these red and green iteration means?
> > > > > Will this cause problem?
> > > > >
> > > > > Thanks & Regards,
> > > > > Akreeti Agarwal
> > > > >
> > > > > ::DISCLAIMER::
> > > > > ________________________________ The contents of this e-mail and
> > > > > any attachment(s) are confidential and intended for the named
> > > > > recipient(s) only. E-mail transmission is not guaranteed to be
> > > > > secure or error-free as information could be intercepted,
> > > > > corrupted, lost, destroyed, arrive late or incomplete, or may
> > > > > contain viruses in transmission. The e mail and its contents
> > > > > (with or without referred errors) shall therefore not attach any
> > > > > liability on the originator or HCL or its affiliates.
> > > > > Views or opinions, if any, presented in this email are solely
> > > > > those of the author and may not necessarily reflect the views or
> > > > > opinions of HCL or
> > > its affiliates.
> > > > > Any form of reproduction, dissemination, copying, disclosure,
> > > > > modification, distribution and / or publication of this message
> > > > > without the prior written consent of authorized representative
> > > > > of HCL is strictly prohibited. If you have received this email
> > > > > in error please delete it and notify the sender immediately.
> > > > > Before opening any email and/or attachments, please check them
> > > > > for viruses and other
> > > > defects.
> > > > > ________________________________
> > > > >
> > > >
> > >
> > >
> > > --
> > > --
> > > Regards,
> > >
> > > *Paras Lehana* [65871]
> > > Software Programmer, Auto-Suggest,
> > > IndiaMART Intermesh Ltd.
> > >
> > > 8th Floor, Tower A, Advant-Navis Business Park, Sector 142, Noida,
> > > UP, IN
> > > - 201303
> > >
> > > Mob.: +91-9560911996
> > > Work: 01203916600 | Extn:  *8173*
> > >
> > > --
> > > IMPORTANT:
> > > NEVER share your IndiaMART OTP/ Password with anyone.
> > >
> >
> >
> > --
> > --
> > Regards,
> >
> > *Paras Lehana* [65871]
> > Software Programmer, Auto-Suggest,
> > IndiaMART Intermesh Ltd.
> >
> > 8th Floor, Tower A, Advant-Navis Business Park, Sector 142, Noida, UP,
> > IN
> > - 201303
> >
> > Mob.: +91-9560911996
> > Work: 01203916600 | Extn:  *8173*
> >
> > --
> > IMPORTANT:
> > NEVER share your IndiaMART OTP/ Password with anyone.
> >
>


-- 
-- 
Regards,

*Paras Lehana* [65871]
Software Programmer, Auto-Suggest,
IndiaMART Intermesh Ltd.

8th Floor, Tower A, Advant-Navis Business Park, Sector 142,
Noida, UP, IN - 201303

Mob.: +91-9560911996
Work: 01203916600 | Extn:  *8173*

-- 
IMPORTANT: 
NEVER share your IndiaMART OTP/ Password with anyone.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message