beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Beryozkin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2328) Introduce Apache Tika Input component
Date Thu, 25 May 2017 16:40:05 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16024981#comment-16024981
] 

Sergey Beryozkin commented on BEAM-2328:
----------------------------------------

The initial code is here:
https://github.com/sberyozkin/beam/tree/tikaio/sdks/java/io/tika

it is a work in progress and it will take me some time to get to the PR stage, just wanted
to share a link to what is already available, perhaps the most interesting code at this stage
is the initial test code:

https://github.com/sberyozkin/beam/blob/tikaio/sdks/java/io/tika/src/test/java/org/apache/beam/sdk/io/tika/TikaInputTest.java

and TikaReader:

https://github.com/sberyozkin/beam/blob/tikaio/sdks/java/io/tika/src/main/java/org/apache/beam/sdk/io/tika/TikaReader.java

For the moment the focus is on getting the overall component structure be in a good enough
initial state (add few more tests, docs), TikaReader (etc) optimizations/enhancements can
def follow after the initial PR.

I'd appreciate if my colleague [~jbonofre] could help next with the initial branch clean up.
thanks

> Introduce Apache Tika Input component
> -------------------------------------
>
>                 Key: BEAM-2328
>                 URL: https://issues.apache.org/jira/browse/BEAM-2328
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-ideas, sdk-java-extensions
>            Reporter: Sergey Beryozkin
>            Assignee: Sergey Beryozkin
>             Fix For: 2.1.0
>
>
> Apache Tika is a popular project that offers an extensive support for parsing the variety
of file formats. It is used in many projects including Lucene and Elastic Search. 
> Supporting a Tika Input (Read) at the Beam level would be of major interest to many users.
> PR is to follow



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message