any23-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ANY23-324) Replace net.sourceforge.nekohtml with jsoup
Date Wed, 24 Jan 2018 06:29:00 GMT

    [ https://issues.apache.org/jira/browse/ANY23-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337001#comment-16337001
] 

Hudson commented on ANY23-324:
------------------------------

SUCCESS: Integrated in Jenkins build Any23-trunk #1525 (See [https://builds.apache.org/job/Any23-trunk/1525/])
ANY23-324 Changed default html parser from NekoHTML to Jsoup. This also (Hans: rev 2c76ada3bc812c37a46863e0529363f42339582a)
* (edit) core/src/main/java/org/apache/any23/extractor/html/HTMLMetaExtractor.java
* (edit) core/src/main/java/org/apache/any23/extractor/html/HCardExtractor.java
* (edit) core/src/test/java/org/apache/any23/extractor/microdata/MicrodataParserTest.java
* (edit) api/src/main/resources/default-configuration.properties
* (edit) core/pom.xml
* (edit) core/src/main/java/org/apache/any23/extractor/html/EmbeddedJSONLDExtractor.java
* (add) core/src/main/java/org/apache/any23/extractor/html/TagSoupParsingConfiguration.java
* (edit) pom.xml
* (edit) core/src/main/java/org/apache/any23/extractor/html/TagSoupParser.java
ANY23-324 Added license to TagSoupParsingConfiguration (Hans: rev 07f7421cd5288b7440bd1a88c21019503770f760)
* (edit) core/src/main/java/org/apache/any23/extractor/html/TagSoupParsingConfiguration.java


> Replace net.sourceforge.nekohtml with jsoup 
> --------------------------------------------
>
>                 Key: ANY23-324
>                 URL: https://issues.apache.org/jira/browse/ANY23-324
>             Project: Apache Any23
>          Issue Type: Improvement
>          Components: core
>            Reporter: Lewis John McGibbney
>            Priority: Major
>             Fix For: 2.2
>
>
> A long standing issue relates to the performance of the existing default [TagSoupParser.java|https://github.com/apache/any23/blob/master/core/src/main/java/org/apache/any23/extractor/html/TagSoupParser.java].
There are a number of issues which now relate to limitations in the way nekohtml parses HTML5
for example [ANY23-317|https://issues.apache.org/jira/browse/ANY23-317], [ANY23-273|https://issues.apache.org/jira/browse/ANY23-273],
[ANY23-267|https://issues.apache.org/jira/browse/ANY23-267]... there are several others.
> I propose to @Deprecate the TagSoupParser.java implementation for the next release (possibly
making it configurable via default-configuration.properties). I also propose to replace it
with https://jsoup.org/. AFAIK, Apache Tika also did this several years ago.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message