lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christoph Straßer (JIRA) <j...@apache.org>
Subject [jira] [Commented] (SOLR-4679) HTML line breaks (<br>) are removed during indexing; causes wrong search results
Date Tue, 09 Apr 2013 06:52:18 GMT

    [ https://issues.apache.org/jira/browse/SOLR-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13626309#comment-13626309
] 

Christoph Straßer commented on SOLR-4679:
-----------------------------------------

Thank you for checking Tika.

As far as i understand http://wiki.apache.org/solr/ExtractingRequestHandler extracts XHTML,
not text. Tika XHTML-option-output looks okay too. 

Root issue - like you said - probably somewhere within Solr.

{noformat}
D:\temp\20130409>java -jar tika-app-1.3.jar --xml external.htm
<?xml version="1.0" encoding="UTF-8"?><html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta name="Content-Length" content="193"/>
<meta name="Content-Encoding" content="windows-1252"/>
<meta name="Content-Type" content="text/html; charset=windows-1252"/>
<meta name="resourceName" content="external.htm"/>
<meta name="dc:title" content="Test mit HTML-Zeilenschaltungen"/>
<title>Test mit HTML-Zeilenschaltungen</title>
</head>
<body><p>
word1
word2

Some other words, a special name like linz
and another special name - vienna
</p>

</body></html>
{noformat}
                
> HTML line breaks (<br>) are removed during indexing; causes wrong search results
> --------------------------------------------------------------------------------
>
>                 Key: SOLR-4679
>                 URL: https://issues.apache.org/jira/browse/SOLR-4679
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>    Affects Versions: 4.2
>         Environment: Windows Server 2008 R2, Java 6, Tomcat 7
>            Reporter: Christoph Straßer
>         Attachments: external.htm, Solr_HtmlLineBreak_Linz_NotFound.png, Solr_HtmlLineBreak_Vienna.png
>
>
> HTML line breaks (<br>, <BR>, <br/>, ...) seem to be removed during
extraction of content from HTML-Files. They need to be replaced with a empty space.
> Test-File:
> <html>
> <head>
> <title>Test mit HTML-Zeilenschaltungen</title>
> </head>
> <p>
> word1<br>word2<br/>
> Some other words, a special name like linz<br>and another special name - vienna
> </p>
> </html>
> The Solr-content-attribute contains the following text:
> Test mit HTML-Zeilenschaltungen    
> word1word2
> Some other words, a special name like linzand another special name - vienna
> So we are not able to find the word "linz".
> We use the ExtractingRequestHandler to put content into Solr. (wiki.apache.org/solr/ExtractingRequestHandler)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message