any23-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ANY23-415) NTriplesExtractor tries all text/plain files, causing numerous fatal issues
Date Sun, 10 Feb 2019 00:07:00 GMT

    [ https://issues.apache.org/jira/browse/ANY23-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764267#comment-16764267
] 

Hudson commented on ANY23-415:
------------------------------

SUCCESS: Integrated in Jenkins build Any23-trunk #1656 (See [https://builds.apache.org/job/Any23-trunk/1656/])
ANY23-415 avoid n-triples errors for humans.txt files, etc (hans: rev 19116220759db9ea6121f8cbfa3893c1ac22f192)
* (add) test-resources/src/test/resources/rdf/issue415.txt
* (edit) core/src/main/java/org/apache/any23/extractor/ExtractionResultImpl.java
* (edit) core/src/main/java/org/apache/any23/extractor/SingleDocumentExtraction.java
* (edit) core/src/test/java/org/apache/any23/Any23Test.java
ANY23-415 narrow generic mimetypes on successful triple extraction (hans: rev 45fe8467d2b76ff857ac33380d589dd5299106d6)
* (edit) core/src/main/java/org/apache/any23/extractor/SingleDocumentExtraction.java
* (edit) core/src/test/java/org/apache/any23/Any23Test.java
* (add) test-resources/src/test/resources/rdf/issue415-valid.txt


> NTriplesExtractor tries all text/plain files, causing numerous fatal issues
> ---------------------------------------------------------------------------
>
>                 Key: ANY23-415
>                 URL: https://issues.apache.org/jira/browse/ANY23-415
>             Project: Apache Any23
>          Issue Type: Bug
>          Components: extractors
>    Affects Versions: 2.3
>            Reporter: Hans Brende
>            Assignee: Hans Brende
>            Priority: Minor
>             Fix For: 2.3
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Since the NTriplesExtractorFactory includes a content type of "text/plain", this causes
every plain text file to be processed by the NTriplesExtractor, which in turn causes huge
numbers of completely unnecessary fatal issues being sent to the extraction report.
> In my crawls, this mostly occurs for all the "humans.txt" files encountered.
> While this isn't a hugely serious bug, it is quite irritating as it does really clutter
up my logs.
>  
> Note: the NQuadsExtractorFactory (which can parse all the same documents as NTriples)
does *not* include a content type of "text/plain".



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message