lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apoorva Gaurav <apoorva.gau...@myntra.com>
Subject Re: External File Field eating memory
Date Wed, 16 Jul 2014 06:29:34 GMT
Thanks Kamal.


On Wed, Jul 16, 2014 at 11:43 AM, Kamal Kishore Aggarwal <
kkroyal.192@gmail.com> wrote:

> Hi Apporva,
>
> This was my master server replication configuration:
>
> core/conf/solrconfig.xml
>
> <requestHandler name="/replication" class="solr.ReplicationHandler" >
> >     <lst name="master">
> >         <str name="replicateAfter">commit</str>
> >         <str name="replicateAfter">startup</str>
> >         <str name="confFiles">../data/external_eff_views</str>
> >     </lst>
> > </requestHandler>
>
>
> It is only configuration files that can be replicated. So, when I wrote the
> above config. The external files was getting replicated in
> core/conf/data/external_eff_views.
> But for solr to read the external file, it looks for it into
> core/data/external_eff_views
> location. So firstly the file was not getting replicated properly.
> Therefore, I did not opted the option of replicating the eff file.
>
> And the second thing is that whenever there is a change in configuration
> files, the core gets reloaded by itself to reflect the changes. I am not
> sure if you can disable this reloading.
>
> Finally, I thought of creating files on slaves in a different way.
>
> Thanks
> Kamal
>
>
> On Tue, Jul 15, 2014 at 11:00 AM, Apoorva Gaurav <
> apoorva.gaurav@myntra.com>
> wrote:
>
> > Hey Kamal,
> > What all config changes have you done to establish replication of
> external
> > files and how have you disabled role reloading?
> >
> >
> > On Wed, Jul 9, 2014 at 11:30 AM, Kamal Kishore Aggarwal <
> > kkroyal.192@gmail.com> wrote:
> >
> > > Hi All,
> > >
> > > It was found that external file, which was getting replicated after
> every
> > > 10 minutes was reloading the core as well. This was increasing the
> query
> > > time.
> > >
> > > Thanks
> > > Kamal Kishore
> > >
> > >
> > >
> > > On Thu, Jul 3, 2014 at 12:48 PM, Kamal Kishore Aggarwal <
> > > kkroyal.192@gmail.com> wrote:
> > >
> > > > With the above replication configuration, the eff file is getting
> > > > replicated at core/conf/data/external_eff_views (new dir data is
> being
> > > > created in conf dir) location, but it is not getting replicated at
> > > core/data/external_eff_views
> > > > on slave.
> > > >
> > > > Please help.
> > > >
> > > >
> > > > On Thu, Jul 3, 2014 at 12:21 PM, Kamal Kishore Aggarwal <
> > > > kkroyal.192@gmail.com> wrote:
> > > >
> > > >> Thanks for your guidance Alexandre Rafalovitch.
> > > >>
> > > >> I am looking into this seriously.
> > > >>
> > > >> Another question is that I facing error in replication of eff file
> > > >>
> > > >> This is master replication configuration:
> > > >>
> > > >> core/conf/solrconfig.xml
> > > >>
> > > >> <requestHandler name="/replication" class="solr.ReplicationHandler"
> >
> > > >>>     <lst name="master">
> > > >>>         <str name="replicateAfter">commit</str>
> > > >>>         <str name="replicateAfter">startup</str>
> > > >>>         <str name="confFiles">../data/external_eff_views</str>
> > > >>>     </lst>
> > > >>> </requestHandler>
> > > >>
> > > >>
> > > >> The eff file is present at core/data/external_eff_views location.
> > > >>
> > > >>
> > > >> On Thu, Jul 3, 2014 at 11:50 AM, Shalin Shekhar Mangar <
> > > >> shalinmangar@gmail.com> wrote:
> > > >>
> > > >>> This might be related:
> > > >>>
> > > >>> https://issues.apache.org/jira/browse/SOLR-3514
> > > >>>
> > > >>>
> > > >>> On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal <
> > > >>> kkroyal.192@gmail.com> wrote:
> > > >>>
> > > >>> > Hi Team,
> > > >>> >
> > > >>> > I have recently implemented EFF in solr. There are about
1.5
> > > >>> lacs(unsorted)
> > > >>> > values in the external file. After this implementation, the
> server
> > > has
> > > >>> > become slow. The solr query time has also increased.
> > > >>> >
> > > >>> > Can anybody confirm me if these issues are because of this
> > > >>> implementation.
> > > >>> > Is that memory does EFF eats up?
> > > >>> >
> > > >>> > Regards
> > > >>> > Kamal Kishore
> > > >>> >
> > > >>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Regards,
> > > >>> Shalin Shekhar Mangar.
> > > >>>
> > > >>
> > > >>
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Apoorva
> >
>



-- 
Thanks & Regards,
Apoorva

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message