lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From KK <dioxide.softw...@gmail.com>
Subject Re: What are the basic requirements for on-the-fly registration/creation of new Core?
Date Wed, 20 May 2009 05:16:16 GMT
Thank you. Let me try the nightly build then I'll let you know.

Thanks,
KK.

2009/5/20 Noble Paul നോബിള്‍ नोब्ळ् <noble.paul@corp.aol.com>

> The dowload is big because it contains a lot of things (read contribs)
> which you may not need. You can just take the solr.war from that.
>
> everything else remains same. All the conf files should be completely
> backward compatible.
>
> all resolved issues will be available in the nightly
>
>
> On Wed, May 20, 2009 at 10:19 AM, KK <dioxide.software@gmail.com> wrote:
> > I'm downloading the nightly build (19thMay09, why is the size so huge
> ~128
> > MB whereas the normal gz one is ~21 MB). I think I just have to replace
> the
> > solr.war file with the nightly one, under tomcat and my rest of the
> config
> > files in $solr.home will remain same. Correct me if I'm wrong. Nightly
> build
> > are the latest ones, right? with all bug fixes done so far included in
> that
> > build.
> >
> >
> > Thanks,
> > KK.
> >
> > 2009/5/19 Noble Paul നോബിള്‍ नोब्ळ् <noble.paul@corp.aol.com>
> >
> >> I am not sure whether it will apply on the 1.3 source. you can give it a
> >> try.
> >>
> >> .a nightly build is your best bet.
> >>
> >>
> >>
> >> On Tue, May 19, 2009 at 7:54 PM, KK <dioxide.software@gmail.com> wrote:
> >> > That jira mentions a patch. That will fix the  bug, right?.
> >> > How do I apply the patch?
> >> >
> >> > Thanks,
> >> > KK>
> >> >
> >> > On Tue, May 19, 2009 at 7:52 PM, KK <dioxide.software@gmail.com>
> wrote:
> >> >>
> >> >> I'm using Solr1.3. I installed it two weeks ago. Current version is
> 1.3,
> >> I
> >> >> guess? Where to get 1.4
> >> >> Do I've to use solr1.4 dev[is it available for public use?] or any
> patch
> >> >> to fix the bug?
> >> >>
> >> >> Thanks,
> >> >> KK.
> >> >>
> >> >> 2009/5/19 Noble Paul നോബിള്‍ नोब्ळ् <noble.paul@corp.aol.com>
> >> >>>
> >> >>> which build are you using ? I guess Solr1.3 had a problem with
> setting
> >> >>> implicit properties which is fixed in Solr 1.4
> >> >>>
> >> >>> https://issues.apache.org/jira/browse/SOLR-883
> >> >>>
> >> >>>
> >> >>>
> >> >>> On Tue, May 19, 2009 at 6:16 PM, KK <dioxide.software@gmail.com>
> >> wrote:
> >> >>> > Thanks a lot @Paul.
> >> >>> > A did as you said and added an entry in solrconfig.xml for
data
> >> >>> > directory.
> >> >>> > But when I tried to register an new core it gave me the following
> >> >>> > error. It
> >> >>> > seems its not able to pick the core name from ${solr.core.name}
> >> [even
> >> >>> > tried
> >> >>> > what you mentioned in your last mail, ${core.name} but no
luck.
> >> >>> >
> >> >>> >
> >> >>> > HTTP Status 500 - No system property or default value specified
> for
> >> >>> > core.name org.apache.solr.common.SolrException: No system
> property
> >> or
> >> >>> > default value specified for solr.core.name at
> >> >>> >
> >> >>> >
> >> org.apache.solr.common.util.DOMUtil.substituteProperty(DOMUtil.java:311)
> at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:264)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:272)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.common.util.DOMUtil.substituteProperties(DOMUtil.java:272)
> >> >>> > at org.apache.solr.core.Config.<init>(Config.java:105)
at
> >> >>> > org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:113)
at
> >> >>> > org.apache.solr.core.CoreContainer.create(CoreContainer.java:321)
> at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:107)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
> >> >>> > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1204)
at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:303)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:232)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
> >> >>> > at
> >> >>> >
> >> >>> >
> >>
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
> >> >>> > at java.lang.Thread.run(Thread.java:619)
> >> >>> >
> >> >>> >
> >> >>> > Thanks,
> >> >>> > KK.
> >> >>> >
> >> >>> >
> >> >>> > 2009/5/19 Noble Paul നോബിള്‍ नोब्ळ्
<noble.paul@corp.aol.com>
> >> >>> >>
> >> >>> >> On Tue, May 19, 2009 at 5:32 PM, KK <dioxide.software@gmail.com>
> >> >>> >> wrote:
> >> >>> >> > Thank you very much Paul. The pictorial explanation
was very
> >> >>> >> > helpful,
> >> >>> >> > made
> >> >>> >> > everything clear. Thank you again.
> >> >>> >> > AFAIU, I can put my existing schema.xml and solrconfig.xml
> under
> >> >>> >> > conf/.
> >> >>> >> > I
> >> >>> >> > assume you also meant passing the paths to common
schema and
> >> >>> >> > solrconfig.xml
> >> >>> >> > when registering a new core? My earlier try gave
me some errors
> >> when
> >> >>> >> > I
> >> >>> >> > tried
> >> >>> >> > to do the same. I'll start afresh and let you know.
> >> >>> >> nope the instanceDir is the only attribute you need to
pass while
> >> >>> >> creating the core
> >> >>> >> >
> >> >>> >> > Thank you,
> >> >>> >> > KK.
> >> >>> >> >
> >> >>> >> > 2009/5/19 Noble Paul നോബിള്‍ नोब्ळ्
<noble.paul@corp.aol.com>
> >> >>> >> >
> >> >>> >> >> forget about the default setup that comes w/
the example.
> >> >>> >> >>
> >> >>> >> >> say you have the following structure
> >> >>> >> >> /data/solr/home/
> >> >>> >> >>                      solr.xml
> >> >>> >> >>                      conf/
> >> >>> >> >>                            schema.xml
> >> >>> >> >>                            solrconfig.xml
> >> >>> >> >>                      data/
> >> >>> >> >>                            /c1/
> >> >>> >> >>                                 index
> >> >>> >> >>                            /c2/
> >> >>> >> >>                                 index
> >> >>> >> >>                            /c3/
> >> >>> >> >>                                 index
> >> >>> >> >>
> >> >>> >> >> * your solr.solr.home is /data/solr/home
> >> >>> >> >> * your common instanceDir will be /data/solr/home/
again. pass
> >> this
> >> >>> >> >> parameter whenever you create a new core.
> >> >>> >> >> * the conf dir contains the common files required
for each
> core.
> >> >>> >> >> * in your common solrconfig.xml keep a tag
> >> >>> >> >> <dataDir>/data/solr/home/data/${solr.core.name}</dataDir>
> .(my
> >> >>> >> >> previous mail had a mistake
> >> >>> >> >> *assume your core names are c1,c2,c3 then solr
will
> automatically
> >> >>> >> >> create a structure as described above. (no need
to create the
> >> dirs
> >> >>> >> >> c1
> >> >>> >> >> or c2 or c3)
> >> >>> >> >>
> >> >>> >> >> HTH
> >> >>> >> >>
> >> >>> >> >>
> >> >>> >> >>
> >> >>> >> >> On Tue, May 19, 2009 at 4:28 PM, KK <
> dioxide.software@gmail.com>
> >> >>> >> >> wrote:
> >> >>> >> >> > Thanks Paul.
> >> >>> >> >> >
> >> >>> >> >> > But I'm a bit confused. I've some questions.
> >> >>> >> >> > # As you said I should have a base core
instance directory
> >> >>> >> >> > containing
> >> >>> >> >> > the
> >> >>> >> >> > conf directory, solrconfig.xml and schema.xml.
Are you
>  Before
> >> >>> >> >> > continuing
> >> >>> >> >> > further I would like to know that the schema
and solrconfig
> >> files
> >> >>> >> >> > placed
> >> >>> >> >> > under the example core0/conf [or core1/conf]
look like
> stripped
> >> >>> >> >> > down
> >> >>> >> >> version
> >> >>> >> >> > of what was available in base solrconfig
and schema. So I
> tried
> >> >>> >> >> > replacing
> >> >>> >> >> > the stripped down files with the base ones
[commenting out
> the
> >> >>> >> >> > data
> >> >>> >> >> > directory tag, as I'm using  solr.xml @solr.home]
for
> >> multicore.
> >> >>> >> >> > After
> >> >>> >> >> > restarting tomcat, surprisingly the core
with replaced files
> >> >>> >> >> > didn't
> >> >>> >> >> > show
> >> >>> >> >> up
> >> >>> >> >> > in the solr welcome page [http://localhost/solr]
but the
> other
> >> >>> >> >> > one
> >> >>> >> >> > was
> >> >>> >> >> there
> >> >>> >> >> > and I moved around all the admin pages and
others. If we are
> >> >>> >> >> > going to
> >> >>> >> >> make
> >> >>> >> >> > use of this stripped down schema and config
files then what
> >> about
> >> >>> >> >> > all
> >> >>> >> >> those
> >> >>> >> >> > things that were mentioned in the base file[I
see a lot of
> >> >>> >> >> > handlers,
> >> >>> >> >> filter
> >> >>> >> >> > factories and many many things], how are
we going to make
> sure
> >> >>> >> >> > that
> >> >>> >> >> > they
> >> >>> >> >> get
> >> >>> >> >> > loaded when solr wakes up. Or the stripped
down files are
> good
> >> >>> >> >> > enough. I
> >> >>> >> >> > need proper guidance on this as I'm still
learning to make
> use
> >> of
> >> >>> >> >> > this
> >> >>> >> >> > wonderful tool called Solr. Thank you Solr
guys.
> >> >>> >> >> >
> >> >>> >> >> > # You said that I can put the data directory
tag things in
> the
> >> >>> >> >> > solrconfig.xml for solr1.3. I agree but
where is the file.
> Are
> >> >>> >> >> > you
> >> >>> >> >> talking
> >> >>> >> >> > about the stripped down solrconfig. If yes
then this doesnot
> >> have
> >> >>> >> >> > any
> >> >>> >> >> data
> >> >>> >> >> > directory entry but the base solrconf file
has this entry,
> >> >>> >> >> > though. If
> >> >>> >> >> > you
> >> >>> >> >> > meant adding the entry in the stripped one,
do confirm me.
> I'll
> >> >>> >> >> > give
> >> >>> >> >> > it a
> >> >>> >> >> > try.
> >> >>> >> >> >
> >> >>> >> >> > Thanks,
> >> >>> >> >> > KK.
> >> >>> >> >> >
> >> >>> >> >> > 2009/5/19 Noble Paul നോബിള്‍
नोब्ळ् <
> noble.paul@corp.aol.com>
> >> >>> >> >> >
> >> >>> >> >> >> On Tue, May 19, 2009 at 2:08 PM, KK
<
> >> dioxide.software@gmail.com>
> >> >>> >> >> >> wrote:
> >> >>> >> >> >> > Hi All,
> >> >>> >> >> >> > Finally I made the multicore thing
running by copying the
> >> >>> >> >> >> > core0
> >> >>> >> >> >> > and
> >> >>> >> >> core1
> >> >>> >> >> >> > directory to $solr.home and putting
a solr.xml file under
> >> the
> >> >>> >> >> >> > same
> >> >>> >> >> >> > directory. A bit relieved !
> >> >>> >> >> >> > I would like to do on-the-fly registration
of core[I've
> >> >>> >> >> >> > provision
> >> >>> >> >> >> > to
> >> >>> >> >> add
> >> >>> >> >> >> > unique corenames everytime I register
a new one] and as
> per
> >> >>> >> >> >> > the
> >> >>> >> >> >> > basic
> >> >>> >> >> >> > requirements mentioned in the wiki[
> >> >>> >> >> http://wiki.apache.org/solr/CoreAdmin]
> >> >>> >> >> >> I
> >> >>> >> >> >> > did the following:
> >> >>> >> >> >> > 1. set persistent="true" and sharedLIb="lib"
> >> >>> >> >> >> >  For this I actually copied the
file given in wiki and
> put
> >> it
> >> >>> >> >> >> > under
> >> >>> >> >> >> > solr.home. Started tomcat and tried
to register a new
> core
> >> >>> >> >> >> > named
> >> >>> >> >> >> > core3
> >> >>> >> >> >> like
> >> >>> >> >> >> > this[I'm running solr on 8080]
> >> >>> >> >> >> >
> >> >>> >> >> >> >
> >> http://localhost:8080/solr/admin/cores?action=CREATE&name=core2
> >> >>> >> >> >> >  and the browser gave me error
saying that instanceDir is
> >> >>> >> >> >> > missing,
> >> >>> >> >> Agreed
> >> >>> >> >> >> > its missing but do I need to provide
the path to a new
> >> >>> >> >> >> > directory
> >> >>> >> >> >> everytime a
> >> >>> >> >> >> > register a new core or any old
core'x directory will do
> the
> >> >>> >> >> >> > job?
> >> >>> >> >> >> > Then
> >> >>> >> >> I
> >> >>> >> >> >> > copied an existing directory core0
to core2 with all its
> >> /bin
> >> >>> >> >> >> > and
> >> >>> >> >> /conf
> >> >>> >> >> >> and
> >> >>> >> >> >> > other stuffs. Then I tried to refresh
the earlier page in
> >> >>> >> >> >> > firefox
> >> >>> >> >> >> > and
> >> >>> >> >> WOW
> >> >>> >> >> >> it
> >> >>> >> >> >> > worked. Then to confirm that the
new core details has
> been
> >> >>> >> >> >> > added
> >> >>> >> >> >> > to
> >> >>> >> >> >> solr.xml
> >> >>> >> >> >> > I cross checked the file and found
a new entry for core2.
> >> Its
> >> >>> >> >> >> > working.
> >> >>> >> >> >> >
> >> >>> >> >> >> > Now let me mention what I want
to do,
> >> >>> >> >> >> > # I want multiple cores, true but
all the core will
> >> >>> >> >> >> > essentially
> >> >>> >> >> >> > have
> >> >>> >> >> the
> >> >>> >> >> >> > same schema and config as well.
> >> >>> >> >> >> > # I want separete index for each
core so that during
> posting
> >> >>> >> >> >> > and
> >> >>> >> >> >> searching I
> >> >>> >> >> >> > can search a specific core
> >> >>> >> >> >> >
> >> >>> >> >> >> > Now I've certain doubts about these
things.
> >> >>> >> >> >> > 1. Do we have to create a new directory
with all those
> /bin
> >> >>> >> >> >> > and
> >> >>> >> >> >> > /conf
> >> >>> >> >> >> > everytime we've to register a new
core. This sounds silly
> >> and
> >> >>> >> >> >> > I'm
> >> >>> >> >> pretty
> >> >>> >> >> >> > sure I must be wrong . There must
be some way to just say
> >> that
> >> >>> >> >> >> > :
> >> >>> >> >> Create
> >> >>> >> >> >> this
> >> >>> >> >> >> > new core having the core name as
ABXZ. The wiki does say
> the
> >> >>> >> >> >> > last
> >> >>> >> >> three
> >> >>> >> >> >> > parameters are optinal [Wiki:Note
that config ,schema &
> >> >>> >> >> >> > dataDir
> >> >>> >> >> >> parameters
> >> >>> >> >> >> > are optional.] Can't we have some
base schema and config
> >> file
> >> >>> >> >> >> > say
> >> >>> >> >> under
> >> >>> >> >> >> > $solr.home [or may be somewhere
else if that creates
> >> problem]
> >> >>> >> >> >> > and
> >> >>> >> >> >> everytime
> >> >>> >> >> >> > we create a new core just point
to those. Can someone
> give
> >> me
> >> >>> >> >> >> > direct
> >> >>> >> >> >> > examples for the same[the wiki
does say about this but
> I'm
> >> not
> >> >>> >> >> completely
> >> >>> >> >> >> > clear about that, some examples
will do the job].
> >> >>> >> >> >> > 2. Do we have to make sure that
the data directory is
> >> sitting
> >> >>> >> >> >> > inside
> >> >>> >> >> >> coreX
> >> >>> >> >> >> > directory, or we can put it elsewhere?
> >> >>> >> >> >>
> >> >>> >> >> >> you don't have to create conf dir and
schema.xml and
> >> >>> >> >> >> solrconfig.xml
> >> >>> >> >> >> for each core separately. keep one instance
dir where you
> have
> >> >>> >> >> >> the
> >> >>> >> >> >> conf dir and its contents. pass the
instanceDir when you
> >> create
> >> >>> >> >> >> a
> >> >>> >> >> >> new
> >> >>> >> >> >> core.
> >> >>> >> >> >>
> >> >>> >> >> >> if you are using 1.3
> >> >>> >> >> >> in the solrconfig.xml , keep the datadir
as follows
> >> >>> >> >> >>
> >> >>> >> >> >> <dataDir>/data/solr/${core.name}</dataDir>
> >> >>> >> >> >>
> >> >>> >> >> >> each core will automatically have a
diffferent dataDir
> >> >>> >> >> >>
> >> >>> >> >> >>
> >> >>> >> >> >>
> >> >>> >> >> >> >
> >> >>> >> >> >> > Thank you very much.
> >> >>> >> >> >> > KK.
> >> >>> >> >> >> >
> >> >>> >> >> >>
> >> >>> >> >> >>
> >> >>> >> >> >>
> >> >>> >> >> >> --
> >> >>> >> >> >> -----------------------------------------------------
> >> >>> >> >> >> Noble Paul | Principal Engineer| AOL
| http://aol.com
> >> >>> >> >> >>
> >> >>> >> >> >
> >> >>> >> >>
> >> >>> >> >>
> >> >>> >> >>
> >> >>> >> >> --
> >> >>> >> >> -----------------------------------------------------
> >> >>> >> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >> >>> >> >>
> >> >>> >> >
> >> >>> >>
> >> >>> >>
> >> >>> >>
> >> >>> >> --
> >> >>> >> -----------------------------------------------------
> >> >>> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>>
> >> >>> --
> >> >>> -----------------------------------------------------
> >> >>> Noble Paul | Principal Engineer| AOL | http://aol.com
> >> >>
> >> >
> >> >
> >>
> >>
> >>
> >> --
> >> -----------------------------------------------------
> >> Noble Paul | Principal Engineer| AOL | http://aol.com
> >>
> >
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message