Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of apoorva.gaurav@myntra.com
 designates 209.85.223.177 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAK7c9g2K4jG5wOLiQn23BhsDx5eXATojrGnD2=gaAONHqZ79Pg@mail.gmail.com>
References: 
 <CAK7c9g1F17jnuBhq+kqoqa-jfJxtVDz2ANQNcY4wn-2WjSUg_w@mail.gmail.com>
 <CAOOKt50V-0sbggqKPu+F72diCWMaOmbv=g6FZ3tz6tnjqnQOww@mail.gmail.com>
 <CAK7c9g3KsoEwvLSQPBkhX3OD5eBySHhytMSO6V9MQhUycXkMbQ@mail.gmail.com>
 <CAK7c9g1tEHyeoBLZ7JsXyXk=bRA6R9Y3twy400fL6c91c_Kj_w@mail.gmail.com>
 <CAK7c9g0FO64LB1LH4F4GDz7UcoEhiCxsWKrJHQRRBjqcOP7w_g@mail.gmail.com>
 <CAJRvvD-160WAiWhyxLUh3juHj_Nzc3EErCQEQOrK6FYoz5NsDg@mail.gmail.com>
 <CAK7c9g2K4jG5wOLiQn23BhsDx5eXATojrGnD2=gaAONHqZ79Pg@mail.gmail.com>
From: Apoorva Gaurav <apoorva.gaurav@myntra.com>
Date: Wed, 16 Jul 2014 11:59:34 +0530
Message-ID: 
 <CAJRvvD9gFtFoGj7ZhjyS9EXcOFqBE+GMVjE2=9Tyxot=5NAe1A@mail.gmail.com>
Subject: Re: External File Field eating memory
To: solr-user <solr-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=e89a8f839fc3fc8a0c04fe49a6cb

--e89a8f839fc3fc8a0c04fe49a6cb
Content-Type: text/plain; charset=UTF-8

Thanks Kamal.


On Wed, Jul 16, 2014 at 11:43 AM, Kamal Kishore Aggarwal <
kkroyal.192@gmail.com> wrote:

> Hi Apporva,
>
> This was my master server replication configuration:
>
> core/conf/solrconfig.xml
>
> <requestHandler name="/replication" class="solr.ReplicationHandler" >
> >     <lst name="master">
> >         <str name="replicateAfter">commit</str>
> >         <str name="replicateAfter">startup</str>
> >         <str name="confFiles">../data/external_eff_views</str>
> >     </lst>
> > </requestHandler>
>
>
> It is only configuration files that can be replicated. So, when I wrote the
> above config. The external files was getting replicated in
> core/conf/data/external_eff_views.
> But for solr to read the external file, it looks for it into
> core/data/external_eff_views
> location. So firstly the file was not getting replicated properly.
> Therefore, I did not opted the option of replicating the eff file.
>
> And the second thing is that whenever there is a change in configuration
> files, the core gets reloaded by itself to reflect the changes. I am not
> sure if you can disable this reloading.
>
> Finally, I thought of creating files on slaves in a different way.
>
> Thanks
> Kamal
>
>
> On Tue, Jul 15, 2014 at 11:00 AM, Apoorva Gaurav <
> apoorva.gaurav@myntra.com>
> wrote:
>
> > Hey Kamal,
> > What all config changes have you done to establish replication of
> external
> > files and how have you disabled role reloading?
> >
> >
> > On Wed, Jul 9, 2014 at 11:30 AM, Kamal Kishore Aggarwal <
> > kkroyal.192@gmail.com> wrote:
> >
> > > Hi All,
> > >
> > > It was found that external file, which was getting replicated after
> every
> > > 10 minutes was reloading the core as well. This was increasing the
> query
> > > time.
> > >
> > > Thanks
> > > Kamal Kishore
> > >
> > >
> > >
> > > On Thu, Jul 3, 2014 at 12:48 PM, Kamal Kishore Aggarwal <
> > > kkroyal.192@gmail.com> wrote:
> > >
> > > > With the above replication configuration, the eff file is getting
> > > > replicated at core/conf/data/external_eff_views (new dir data is
> being
> > > > created in conf dir) location, but it is not getting replicated at
> > > core/data/external_eff_views
> > > > on slave.
> > > >
> > > > Please help.
> > > >
> > > >
> > > > On Thu, Jul 3, 2014 at 12:21 PM, Kamal Kishore Aggarwal <
> > > > kkroyal.192@gmail.com> wrote:
> > > >
> > > >> Thanks for your guidance Alexandre Rafalovitch.
> > > >>
> > > >> I am looking into this seriously.
> > > >>
> > > >> Another question is that I facing error in replication of eff file
> > > >>
> > > >> This is master replication configuration:
> > > >>
> > > >> core/conf/solrconfig.xml
> > > >>
> > > >> <requestHandler name="/replication" class="solr.ReplicationHandler"
> >
> > > >>>     <lst name="master">
> > > >>>         <str name="replicateAfter">commit</str>
> > > >>>         <str name="replicateAfter">startup</str>
> > > >>>         <str name="confFiles">../data/external_eff_views</str>
> > > >>>     </lst>
> > > >>> </requestHandler>
> > > >>
> > > >>
> > > >> The eff file is present at core/data/external_eff_views location.
> > > >>
> > > >>
> > > >> On Thu, Jul 3, 2014 at 11:50 AM, Shalin Shekhar Mangar <
> > > >> shalinmangar@gmail.com> wrote:
> > > >>
> > > >>> This might be related:
> > > >>>
> > > >>> https://issues.apache.org/jira/browse/SOLR-3514
> > > >>>
> > > >>>
> > > >>> On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal <
> > > >>> kkroyal.192@gmail.com> wrote:
> > > >>>
> > > >>> > Hi Team,
> > > >>> >
> > > >>> > I have recently implemented EFF in solr. There are about 1.5
> > > >>> lacs(unsorted)
> > > >>> > values in the external file. After this implementation, the
> server
> > > has
> > > >>> > become slow. The solr query time has also increased.
> > > >>> >
> > > >>> > Can anybody confirm me if these issues are because of this
> > > >>> implementation.
> > > >>> > Is that memory does EFF eats up?
> > > >>> >
> > > >>> > Regards
> > > >>> > Kamal Kishore
> > > >>> >
> > > >>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Regards,
> > > >>> Shalin Shekhar Mangar.
> > > >>>
> > > >>
> > > >>
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Apoorva
> >
>


-- 
Thanks & Regards,
Apoorva

--e89a8f839fc3fc8a0c04fe49a6cb--