lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Jelsma (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-3808) Extraction contrib to utilize Boilerpipe
Date Fri, 07 Sep 2012 10:03:08 GMT

     [ https://issues.apache.org/jira/browse/SOLR-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Markus Jelsma updated SOLR-3808:
--------------------------------

    Attachment: SOLR-3808-trunk-1.patch

Here's a patch for trunk. It introduces the boilerpipe parameter which takes a names Boilerpipe
extractor such as ArticleExtractor, CanolaExtractor or KeepEverythingExtractor.

It also comes with a unit test. The test HTML file's extracted content will not contain the
word `footer` if the ArticleExtractor is used.
                
> Extraction contrib to utilize Boilerpipe
> ----------------------------------------
>
>                 Key: SOLR-3808
>                 URL: https://issues.apache.org/jira/browse/SOLR-3808
>             Project: Solr
>          Issue Type: Improvement
>          Components: contrib - Solr Cell (Tika extraction)
>            Reporter: Markus Jelsma
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: SOLR-3808-trunk-1.patch
>
>
> Solr's extraction contrib uses Tika for document parsing and should be able te use Boilerpipe.
Tika comes with Boilerpipe, a library capable of removing boilerplate text from HTML pages.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message