Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of robertpe@buy.com designates
 209.67.181.94 as permitted sender)
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Subject: RE: Exception searching PhoneticFilterFactory field with number
Date: Thu, 23 Jul 2009 16:12:00 -0700
Message-ID: <11B8ADF3AAA0A84C89B1A42CADF918D380A13B@email01>
In-Reply-To: <11B8ADF3AAA0A84C89B1A42CADF918D380A13A@email01>
Thread-Topic: Exception searching PhoneticFilterFactory field with number
thread-index: AcoJpPwB3zic+RVsSAGZxp1HzWFCnwCPrANQAAF31PA=
References: <11B8ADF3AAA0A84C89B1A42CADF918D380A0E6@email01>
 <11B8ADF3AAA0A84C89B1A42CADF918D380A0E8@email01>
 <906105.36914.qm@web50308.mail.re2.yahoo.com>
 <11B8ADF3AAA0A84C89B1A42CADF918D380A13A@email01>
From: "Robert Petersen" <robertpe@buy.com>
To: <solr-user@lucene.apache.org>

Actually my first question should be, "Is this a known bug or am I doing
something wrong?"

The only one thing I can find on this topic is the following statement
on the solr-dev group when discussing adding the maxCodeLength, see
point two below:

Ryan McKinley updated SOLR-813:

-------------------------------

Attachment: SOLR-813.patch

Here is an update that adresses two concerns:=20
1. position increments -- this keeps the tokens in sync with the input=20
2. previous version would stop processing after a number. That is: "aaa
1234
bbb" would not process "bbb" 3. Token types... this changes it to
"DoubleMetaphone" rather then "ALPHANUM"


-----Original Message-----
From: Robert Petersen [mailto:robertpe@buy.com]=20
Sent: Thursday, July 23, 2009 3:24 PM
To: solr-user@lucene.apache.org
Subject: RE: Exception searching PhoneticFilterFactory field with number

Sure Otis, and in fact I can narrow it down to just exactly that query,
but with user queries I don't think it is right to throw an exception
out of phonetic filter factory if the user enters a number.  What I am
saying is am I going to have to filter the user queries for numerics
before using it to search in my double metaphone version of my titles?
That doesn't seem good.

Jul 23, 2009 2:58:17 PM org.apache.solr.core.SolrCore execute
INFO: [10017] webapp=3D/solr path=3D/select/
params=3D{debugQuery=3Dtrue&rows=3D10&start=3D0&q=3D((((allDoublemetaphon=
e:"2343")
^0.5)))} hits=3D6873 status=3D500 QTime=3D3=20
Jul 23, 2009 2:58:17 PM org.apache.solr.common.SolrException log
SEVERE: java.lang.RuntimeException: java.lang.IllegalArgumentException:
name and value cannot both be empty
	at
org.apache.solr.search.QueryParsing.toString(QueryParsing.java:470)
	at
org.apache.solr.util.SolrPluginUtils.doStandardDebug(SolrPluginUtils.jav
a:399)
	at
org.apache.solr.handler.component.DebugComponent.process(DebugComponent.
java:54)
	at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(Search
Handler.java:177)
	at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerB
ase.java:131)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1205)
	at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.ja
va:303)
	at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.j
ava:232)
	at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica
tionFilterChain.java:235)
	at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt
erChain.java:206)
	at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValv
e.java:233)
	at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValv
e.java:191)
	at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java
:128)
	at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java
:102)
	at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.
java:109)
	at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:2
86)
	at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:84
5)
	at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(
Http11Protocol.java:583)
	at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
	at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.IllegalArgumentException: name and value cannot
both be empty
	at org.apache.lucene.document.Field.<init>(Field.java:277)
	at org.apache.lucene.document.Field.<init>(Field.java:251)
	at
org.apache.solr.search.QueryParsing.writeFieldVal(QueryParsing.java:307)
	at
org.apache.solr.search.QueryParsing.toString(QueryParsing.java:320)
	at
org.apache.solr.search.QueryParsing.toString(QueryParsing.java:467)
	... 19 more


-----Original Message-----
From: Otis Gospodnetic [mailto:otis_gospodnetic@yahoo.com]=20
Sent: Monday, July 20, 2009 6:45 PM
To: solr-user@lucene.apache.org
Subject: Re: Exception searching PhoneticFilterFactory field with number


Robert,

Can you narrow things down by simplifying the query?  For example, I see
allDoublemetaphone:"2226", which looks suspicious in the "give me
phonetic version of the input" context, but if you could narrow it down,
we could probably be able to help more.

 Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch


----- Original Message ----
> From: Robert Petersen <robertpe@buy.com>
> To: solr-user@lucene.apache.org
> Sent: Monday, July 20, 2009 12:11:38 PM
> Subject: Exception searching PhoneticFilterFactory field with number
>=20
> Reposting in hopes of an answer...
>=20
>=20
>=20
> Hello all,=20
>=20
>=20
>=20
> I am getting the following exception whenever a user includes a
numeric
> term in their search, and the search includes a field defined with a
> PhoneticFilterFactory and further it occurs whether I use the
> DoubleMetaphone encoder or any other.  Has this ever come up before?
I
> can replicate this with no data in the index at all, but if I search
the
> field by hand from the solr web interface there is no exception.  I am
> running the lucid imagination 1.3 certified release in a multicore
> master/slaves configuration.  I will include the field def and the
> search/exception below and let me know if I can include any more
> clues... seems like it's trying to make a field with no name/value: =20
>=20
>=20
>=20
>=20
> positionIncrementGap=3D"100">
>=20
>=20
>=20
>                        =20
> class=3D"solr.WhitespaceTokenizerFactory"/>
>=20
>                        =20
> synonyms=3D"index_synonyms.txt" ignoreCase=3D"true" expand=3D"false"/>
>=20
>                        =20
> ignoreCase=3D"true" words=3D"stopwords.txt"/>
>=20
>                        =20
>=20
>                        =20
>=20
>                        =20
> protected=3D"protwords.txt"/>
>=20
>                        =20
> class=3D"solr.RemoveDuplicatesTokenFilterFactory"/>
>=20
>                        =20
> encoder=3D"DoubleMetaphone" inject=3D"false"/>
>=20
>=20
>=20
>=20
>=20
>                        =20
> class=3D"solr.WhitespaceTokenizerFactory"/>
>=20
>                        =20
> synonyms=3D"query_synonyms.txt" ignoreCase=3D"true" expand=3D"true"/>
>=20
>                        =20
> ignoreCase=3D"true" words=3D"stopwords.txt"/>
>=20
>                        =20
>=20
>                        =20
>=20
>                        =20
> protected=3D"protwords.txt"/>
>=20
>                        =20
> class=3D"solr.RemoveDuplicatesTokenFilterFactory"/>
>=20
>                        =20
> encoder=3D"DoubleMetaphone" inject=3D"false"/>
>=20
>=20
>=20
>=20
>=20
>=20
>=20
> Jul 17, 2009 2:42:18 PM org.apache.solr.core.SolrCore execute
>=20
> INFO: [10017] webapp=3D/solr path=3D/select/
>
params=3D{f.partitionId.facet.limit=3D10&f.categoryId.facet.missing=3Dfal=
se&f.
>
categoryId.facet.zeros=3Dfalse&facet=3Dtrue&facet=3Dtrue&facet=3Dtrue&fac=
et=3Dtrue
>
&facet=3Dtrue&facet=3Dtrue&f.taxonomyCategoryId.facet.limit=3D-1&f.priceB=
ucket
>
id.facet.limit=3D-1&f.partitionId.facet.zeros=3Dfalse&f.categoryId.facet.=
sor
>
t=3Dtrue&f.categoryId.facet.limit=3D-1&f.marketplaceIds.facet.limit=3D10&=
f.mfg
>
Id.facet.missing=3Dfalse&f.priceBucketid.facet.zeros=3Dfalse&debugQuery=3D=
true
>
&f.priceBucketid.facet.sort=3Dtrue&f.partitionId.facet.missing=3Dfalse&f.=
tax
>
onomyCategoryId.facet.zeros=3Dfalse&f.priceBucketid.facet.missing=3Dfalse=
&fa
>
cet.field=3DcategoryId&facet.field=3DtaxonomyCategoryId&facet.field=3Dpar=
titio
>
nId&facet.field=3DmfgId&facet.field=3DmarketplaceIds&facet.field=3DpriceB=
ucket
>
id&f.mfgId.facet.zeros=3Dfalse&f.taxonomyCategoryId.facet.sort=3Dtrue&f.m=
ark
>
etplaceIds.facet.missing=3Dfalse&rows=3D48&f.partitionId.facet.sort=3Dtru=
e&sta
>
rt=3D0&q=3D(((((sku:"va"+AND+sku:"2226"+AND+sku:"w"))+OR+((upc:"va"+AND+u=
pc:
>
"2226"+AND+upc:"w"))+OR+((mfgPartNo:"va"+AND+mfgPartNo:"2226"+AND+mfgPar
>
tNo:"w"))+OR+((title_en_uk:"va"+AND+title_en_uk:"2226"+AND+title_en_uk:"
>
w"))^8+OR+((moreWords_en_uk:"va"+AND+moreWords_en_uk:"2226"+AND+moreWord
>
s_en_uk:"w"))^2+OR+((allDoublemetaphone:"va"+AND+allDoublemetaphone:"222
>
6"+AND+allDoublemetaphone:"w"))^0.5)+AND+((_val_:"sum\(product\(boosted,
>
300000\),product\(sales,1000\),product\(views,10\),product\(image,100\)\
>
)"))))&f.taxonomyCategoryId.facet.missing=3Dfalse&f.mfgId.facet.limit=3D1=
0&f
>
.marketplaceIds.facet.sort=3Dtrue&f.marketplaceIds.facet.zeros=3Dfalse&f.=
mfg
> Id.facet.sort=3Dtrue} hits=3D0 status=3D500 QTime=3D84=20
>=20
> Jul 17, 2009 2:42:18 PM org.apache.solr.common.SolrException log
>=20
> SEVERE: java.lang.RuntimeException:
java.lang.IllegalArgumentException:
> name and value cannot both be empty
>=20
>                 at
> org.apache.solr.search.QueryParsing.toString(QueryParsing.java:470)
>=20
>                 at
>
org.apache.solr.util.SolrPluginUtils.doStandardDebug(SolrPluginUtils.jav
> a:399)
>=20
>                 at
>
org.apache.solr.handler.component.DebugComponent.process(DebugComponent.
> java:54)
>=20
>                 at
>
org.apache.solr.handler.component.SearchHandler.handleRequestBody(Search
> Handler.java:177)
>=20
>                 at
>
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerB
> ase.java:131)
>=20
>                 at
> org.apache.solr.core.SolrCore.execute(SolrCore.java:1205)
>=20
>                 at
>
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.ja
> va:303)
>=20
>                 at
>
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.j
> ava:232)
>=20
>                 at
>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica
> tionFilterChain.java:235)
>=20
>                 at
>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt
> erChain.java:206)
>=20
>                 at
>
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValv
> e.java:233)
>=20
>                 at
>
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValv
> e.java:191)
>=20
>                 at
>
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java
> :128)
>=20
>                 at
>
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java
> :102)
>=20
>                 at
>
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.
> java:109)
>=20
>                 at
>
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:2
> 86)
>=20
>                 at
>
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:84
> 5)
>=20
>                 at
>
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(
> Http11Protocol.java:583)
>=20
>                 at
>
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
>=20
>                 at java.lang.Thread.run(Thread.java:619)
>=20
> Caused by: java.lang.IllegalArgumentException: name and value cannot
> both be empty
>=20
>                 at
> org.apache.lucene.document.Field.(Field.java:277)
>=20
>                 at
> org.apache.lucene.document.Field.(Field.java:251)
>=20
>                 at
>
org.apache.solr.search.QueryParsing.writeFieldVal(QueryParsing.java:307)
>=20
>                 at
> org.apache.solr.search.QueryParsing.toString(QueryParsing.java:320)
>=20
>                 at
> org.apache.solr.search.QueryParsing.toString(QueryParsing.java:402)
>=20
>                 at
> org.apache.solr.search.QueryParsing.toString(QueryParsing.java:402)
>=20
>                 at
> org.apache.solr.search.QueryParsing.toString(QueryParsing.java:402)
>=20
>                 at
> org.apache.solr.search.QueryParsing.toString(QueryParsing.java:467)
>=20
>                 ... 19 more