lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kamal Kishore Aggarwal <kkroyal....@gmail.com>
Subject Re: External File Field eating memory
Date Wed, 16 Jul 2014 06:13:49 GMT
Hi Apporva,

This was my master server replication configuration:

core/conf/solrconfig.xml

<requestHandler name="/replication" class="solr.ReplicationHandler" >
>     <lst name="master">
>         <str name="replicateAfter">commit</str>
>         <str name="replicateAfter">startup</str>
>         <str name="confFiles">../data/external_eff_views</str>
>     </lst>
> </requestHandler>


It is only configuration files that can be replicated. So, when I wrote the
above config. The external files was getting replicated in
core/conf/data/external_eff_views.
But for solr to read the external file, it looks for it into
core/data/external_eff_views
location. So firstly the file was not getting replicated properly.
Therefore, I did not opted the option of replicating the eff file.

And the second thing is that whenever there is a change in configuration
files, the core gets reloaded by itself to reflect the changes. I am not
sure if you can disable this reloading.

Finally, I thought of creating files on slaves in a different way.

Thanks
Kamal


On Tue, Jul 15, 2014 at 11:00 AM, Apoorva Gaurav <apoorva.gaurav@myntra.com>
wrote:

> Hey Kamal,
> What all config changes have you done to establish replication of external
> files and how have you disabled role reloading?
>
>
> On Wed, Jul 9, 2014 at 11:30 AM, Kamal Kishore Aggarwal <
> kkroyal.192@gmail.com> wrote:
>
> > Hi All,
> >
> > It was found that external file, which was getting replicated after every
> > 10 minutes was reloading the core as well. This was increasing the query
> > time.
> >
> > Thanks
> > Kamal Kishore
> >
> >
> >
> > On Thu, Jul 3, 2014 at 12:48 PM, Kamal Kishore Aggarwal <
> > kkroyal.192@gmail.com> wrote:
> >
> > > With the above replication configuration, the eff file is getting
> > > replicated at core/conf/data/external_eff_views (new dir data is being
> > > created in conf dir) location, but it is not getting replicated at
> > core/data/external_eff_views
> > > on slave.
> > >
> > > Please help.
> > >
> > >
> > > On Thu, Jul 3, 2014 at 12:21 PM, Kamal Kishore Aggarwal <
> > > kkroyal.192@gmail.com> wrote:
> > >
> > >> Thanks for your guidance Alexandre Rafalovitch.
> > >>
> > >> I am looking into this seriously.
> > >>
> > >> Another question is that I facing error in replication of eff file
> > >>
> > >> This is master replication configuration:
> > >>
> > >> core/conf/solrconfig.xml
> > >>
> > >> <requestHandler name="/replication" class="solr.ReplicationHandler"
>
> > >>>     <lst name="master">
> > >>>         <str name="replicateAfter">commit</str>
> > >>>         <str name="replicateAfter">startup</str>
> > >>>         <str name="confFiles">../data/external_eff_views</str>
> > >>>     </lst>
> > >>> </requestHandler>
> > >>
> > >>
> > >> The eff file is present at core/data/external_eff_views location.
> > >>
> > >>
> > >> On Thu, Jul 3, 2014 at 11:50 AM, Shalin Shekhar Mangar <
> > >> shalinmangar@gmail.com> wrote:
> > >>
> > >>> This might be related:
> > >>>
> > >>> https://issues.apache.org/jira/browse/SOLR-3514
> > >>>
> > >>>
> > >>> On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal <
> > >>> kkroyal.192@gmail.com> wrote:
> > >>>
> > >>> > Hi Team,
> > >>> >
> > >>> > I have recently implemented EFF in solr. There are about 1.5
> > >>> lacs(unsorted)
> > >>> > values in the external file. After this implementation, the server
> > has
> > >>> > become slow. The solr query time has also increased.
> > >>> >
> > >>> > Can anybody confirm me if these issues are because of this
> > >>> implementation.
> > >>> > Is that memory does EFF eats up?
> > >>> >
> > >>> > Regards
> > >>> > Kamal Kishore
> > >>> >
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> Regards,
> > >>> Shalin Shekhar Mangar.
> > >>>
> > >>
> > >>
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Apoorva
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message