lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan McKinley <ryan...@gmail.com>
Subject Re: Multicore Issue with nightly build
Date Tue, 08 Apr 2008 18:11:08 GMT
from the client side, multicore should behave exactly the same as  
multi single core servers running next to each other.

I'm not familiar with the perl client, but it will need to be  
configured for each core -- rather then one client that talks to  
multiple cores.

while you install solr at:
http://host/context

you will access each core at:
http://host/context/coreX
http://host/context/coreY

ryan


On Apr 8, 2008, at 9:51 AM, kirk beers wrote:
> Hello again,
>
> I finally managed to add/update solr single core by using Perl CPAN  
> Solr by
> Timothy Garafola. But I am unable to actually update or add anything  
> to a
> multicore environment !
>
> I was wondering if I am doing something incorrectly or if there is  
> an issue
> at this point? Should I be editing the schema.xml for the specific  
> core ?
>
> Thank you
>
> K
>
>
> On Mon, Apr 7, 2008 at 12:54 PM, kirk beers <kgbjed@gmail.com> wrote:
>
>> Which schema.xml are you referring to ? The core0 schema.xml or the  
>> main
>> schema.xml ? Because I get the following error when I use :
>>
>> <field name="cat">camera</field>
>>
>> I get this error:
>>
>> <result status="1">org.apache.solr.common.SolrException:  
>> ERROR:unknown
>> field 'cat'
>>        at
>> org 
>> .apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java: 
>> 245)
>>        at
>> org 
>> .apache 
>> .solr 
>> .update 
>> .processor 
>> .RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:66)
>>        at
>> org 
>> .apache 
>> .solr 
>> .handler 
>> .XmlUpdateRequestHandler.processUpdate(XmlUpdateRequestHandler.java: 
>> 196)
>>        at
>> org 
>> .apache 
>> .solr 
>> .handler 
>> .XmlUpdateRequestHandler 
>> .doLegacyUpdate(XmlUpdateRequestHandler.java:386)
>>        at
>> org 
>> .apache 
>> .solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:65)
>>        at javax.servlet.http.HttpServlet.service(HttpServlet.java: 
>> 710)
>>        at javax.servlet.http.HttpServlet.service(HttpServlet.java: 
>> 803)
>>        at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain 
>> .internalDoFilter(ApplicationFilterChain.java:269)
>>        at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 
>> 188)
>>        at
>> org 
>> .apache 
>> .solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java: 
>> 320)
>>        at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain 
>> .internalDoFilter(ApplicationFilterChain.java:215)
>>        at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 
>> 188)
>>        at
>> org 
>> .apache 
>> .catalina 
>> .core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
>>        at
>> org 
>> .apache 
>> .catalina 
>> .core.StandardContextValve.invoke(StandardContextValve.java:174)
>>        at
>> org 
>> .apache 
>> .catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>>        at
>> org 
>> .apache 
>> .catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
>>        at
>> org 
>> .apache 
>> .catalina.core.StandardEngineValve.invoke(StandardEngineValve.java: 
>> 108)
>>        at
>> org 
>> .apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java: 
>> 151)
>>        at
>> org 
>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: 
>> 874)
>>        at
>> org.apache.coyote.http11.Http11BaseProtocol 
>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: 
>> 665)
>>        at
>> org 
>> .apache 
>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: 
>> 528)
>>        at
>> org 
>> .apache 
>> .tomcat 
>> .util 
>> .net 
>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
>>        at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:689)
>>        at java.lang.Thread.run(Thread.java:619)
>>
>> =================================================================
>>
>>
>>
>> On Mon, Apr 7, 2008 at 11:50 AM, Thomas Arni <arni.thomas@gmail.com>
>> wrote:
>>
>>> Please make sure that you do NOT have a field called "category" in
>>> in the documents you would like to add. For example:
>>>
>>> <field name="category">camera</field>
>>>
>>> I am almost sure you have some documents,
>>> which have this  field "category" instead of "cat".
>>>
>>> You can also add the field "category" to your schema.xml file and  
>>> copy
>>> it to the "cat" field.
>>>
>>> kirk beers said the following on 07/04/2008 15:40:
>>>
>>> Hi Ryan,
>>>>
>>>> I re installed the multicore set up and I have it running and  
>>>> working
>>>> properly. The cores newswire2 etc contained indexes from a prior
>>>> Lucene
>>>> application which did not seem to work in the multicore set-up.
>>>>
>>>> Now that I have multicore running are there any instructions on  
>>>> how to
>>>> add/update individual cores with new docs ? I have set  a core0  
>>>> as a
>>>> default  within multicore to make it updateable ? But now I keep
>>>> getting
>>>> errors from curl that says it does not  recognize specific  field
>>>> names
>>>> like 'cat' which seem to be declared in both .
>>>>
>>>> I am likewise using the following line command :
>>>>
>>>> curl -d @add.xml http://localhost:8080/solr/update
>>>>
>>>> Here is the contents of add.xml
>>>>
>>>> <add>
>>>> <doc>
>>>>   <field name="id">9885A004</field>
>>>>   <field name="name">Canon PowerShot SD500</field>
>>>>   <field name="cat">camera</field>
>>>>   <field name="features">3x optical zoom</field>
>>>>   <field name="features">aluminum case</field>
>>>>   <field name="weight">6.4</field>
>>>>   <field name="price">329.95</field>
>>>> </doc>
>>>> </add>
>>>>
>>>> Here is the core0 schema:
>>>>
>>>> <schema name="example core0" version="1.1">
>>>> <types>
>>>>  <fieldtype name="string"  class="solr.StrField"
>>>> sortMissingLast="true"
>>>> omitNorms="true"/>
>>>> </types>
>>>>
>>>> <fields>
>>>> <!-- general -->
>>>> <field name="id"      type="string"   indexed="true"  stored="true"
>>>> multiValued="false" required="true"/>
>>>> <field name="type"    type="string"   indexed="true"  stored="true"
>>>> multiValued="false" />
>>>> <field name="name"    type="string"   indexed="true"  stored="true"
>>>> multiValued="false" />
>>>> <field name="core0"   type="string"   indexed="true"  stored="true"
>>>> multiValued="false" />
>>>> <field name="cat"    type="string"   indexed="true"  stored="true"
>>>> multiValued="false" />
>>>> </fields>
>>>>
>>>> <!-- field to use to determine and enforce document uniqueness. -->
>>>> <uniqueKey>id</uniqueKey>
>>>>
>>>> <!-- field for the QueryParser to use when an explicit fieldname is
>>>> absent
>>>> -->
>>>> <defaultSearchField>name</defaultSearchField>
>>>>
>>>> <!-- SolrQueryParser configuration: defaultOperator="AND|OR" -->
>>>> <solrQueryParser defaultOperator="OR"/>
>>>> </schema>
>>>>
>>>>
>>>> Here is the error I get:
>>>>
>>>> kirber@kirk
>>>> :~/Desktop/tomcat-solr/apache-solr-nightly/example/exampledocs$
>>>> curl -d @add.xml http://localhost:8080/solr/update/
>>>> <result status="1">org.apache.solr.common.SolrException:  
>>>> ERROR:unknown
>>>> field
>>>> 'category'
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:245)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .solr 
>>>> .update 
>>>> .processor 
>>>> .RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:66)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .solr 
>>>> .handler 
>>>> .XmlUpdateRequestHandler 
>>>> .processUpdate(XmlUpdateRequestHandler.java:196)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .solr 
>>>> .handler 
>>>> .XmlUpdateRequestHandler 
>>>> .doLegacyUpdate(XmlUpdateRequestHandler.java:386)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:65)
>>>>       at javax.servlet.http.HttpServlet.service(HttpServlet.java: 
>>>> 710)
>>>>       at javax.servlet.http.HttpServlet.service(HttpServlet.java: 
>>>> 803)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core 
>>>> .ApplicationFilterChain 
>>>> .internalDoFilter(ApplicationFilterChain.java:269)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 
>>>> 188)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java: 
>>>> 320)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core 
>>>> .ApplicationFilterChain 
>>>> .internalDoFilter(ApplicationFilterChain.java:215)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 
>>>> 188)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core.StandardContextValve.invoke(StandardContextValve.java:174)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina 
>>>> .core.StandardEngineValve.invoke(StandardEngineValve.java:108)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .coyote.http11.Http11Processor.process(Http11Processor.java:874)
>>>>       at
>>>>
>>>> org.apache.coyote.http11.Http11BaseProtocol 
>>>> $ 
>>>> Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: 
>>>> 665)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .tomcat 
>>>> .util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
>>>>       at
>>>>
>>>> org 
>>>> .apache 
>>>> .tomcat 
>>>> .util 
>>>> .net 
>>>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java: 
>>>> 81)
>>>>       at
>>>>
>>>> org.apache.tomcat.util.threads.ThreadPool 
>>>> $ControlRunnable.run(ThreadPool.java:689)
>>>>       at java.lang.Thread.run(Thread.java:619)
>>>> </result>kirber@kirk
>>>> :~/Desktop/tomcat-solr/apache-solr-nightly/example/exampledocs$
>>>>
>>>> Thanks
>>>>
>>>> On Thu, Apr 3, 2008 at 11:10 AM, Ryan McKinley <ryantxu@gmail.com>
>>>> wrote:
>>>>
>>>>
>>>>
>>>>> Do the cores: newswire2, TestIndex, and core5 work on their own?
>>>>>
>>>>> Can you load each of them into a clean multicore environment?
>>>>>
>>>>> (Grasping here but...) perhaps there is something wrong with the
>>>>> config
>>>>> for thoes cores and they don't initalize properly and there is  
>>>>> not a
>>>>> nice
>>>>> error.
>>>>>
>>>>> Do the logs show anything useful?  Anything relevent to these  
>>>>> cores?
>>>>>
>>>>> ryan
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Apr 3, 2008, at 9:19 AM, kirk beers wrote:
>>>>>
>>>>> Hi Folks,
>>>>>
>>>>>
>>>>>> I created 5 initial cores all individual and successively named
>>>>>> core(0-4)
>>>>>> This worked fine! Then I added 3 more cores: newswire2,  
>>>>>> TestIndex,
>>>>>> and
>>>>>> core5.
>>>>>> I added newswire2 and TestIndex first then added core5, thinking
>>>>>> it may
>>>>>> be a naming
>>>>>> issue, but these never get picked up by the server.
>>>>>>
>>>>>> Below is the environment I am using.
>>>>>>
>>>>>> When I enter:
>>>>>>
>>>>>> http://localhost:8080/solr/ or
>>>>>> http://localhost:8080/solr/core0/select?q=*:*
>>>>>>
>>>>>> I get responses for the first 5 cores but nothing for the other 

>>>>>> 3.
>>>>>>
>>>>>> I am using :
>>>>>>
>>>>>> Linux Ubuntu 7.10 with all updates
>>>>>> tomcat-solr --> Tomcat 5.5.25
>>>>>>                 --> solr-2008-03-18.zip
>>>>>>
>>>>>>
>>>>>> Here is a copy of my multicore.xml
>>>>>>
>>>>>> <multicore adminPath="/admin/multicore" persistent="true" >
>>>>>> <core name="core0" instanceDir="core0" default="true"/>
>>>>>> <core name="core1" instanceDir="core1"/>
>>>>>> <core name="core2" instanceDir="core2"/>
>>>>>> <core name="core3" instanceDir="core3"/>
>>>>>> <core name="core4" instanceDir="core4"/>
>>>>>> <core name="TestIndex" instanceDir="TestIndex"/>
>>>>>> <core name="newswire2" instanceDir="newswire2"/>
>>>>>> <core name="core5" instanceDir="core5"/>
>>>>>> </multicore>
>>>>>>
>>>>>> Here are the core names declared in each individual schema.xml  
>>>>>> per
>>>>>> core.
>>>>>>
>>>>>> <field name="core0"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="core1"    type="string"    indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="core2"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="core3"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="core4"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="core5"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="newswire2"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>> <field name="TestIndex"   type="string"   indexed="true"
>>>>>> stored="true"
>>>>>> multiValued="false" />
>>>>>>
>>>>>> My file structure is as follows:
>>>>>>
>>>>>> solr  --> admin
>>>>>>      --> bin
>>>>>>      --> conf
>>>>>>      --> data
>>>>>>      --> META-INF
>>>>>>      --> WEB-INF
>>>>>>      --> core0 --->  bin
>>>>>>                      --->  conf --> schema.xml
>>>>>>                                       --> solrconfig.xml
>>>>>>                             data --> index
>>>>>>      --> core1
>>>>>>      --> core2
>>>>>>      --> core3
>>>>>>      --> core4
>>>>>>      --> core5
>>>>>>      --> TestIndex
>>>>>>      --> newswire2
>>>>>> I attached a copy of this email as well in case the integrity of
>>>>>> the
>>>>>> email is comprimised.
>>>>>> Any help would be greatly appreciated ... Thank you in advance.
>>>>>>
>>>>>> Kirk
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>


Mime
View raw message