beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Groh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-181) Make TextIOTest and AvroIOTest runner-agnostic
Date Sat, 18 Jun 2016 00:30:05 GMT

    [ https://issues.apache.org/jira/browse/BEAM-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15337323#comment-15337323
] 

Thomas Groh commented on BEAM-181:
----------------------------------

The idea is to first convert all the reads and writes that use the Java File API to use IOChannelUtil
instead, with the existing temporary locations (which can still be obtained the same way;
just written to differently). After that is completed, a location can be provided to the test
by the test configuration, which can differ depending on the runner.

> Make TextIOTest and AvroIOTest runner-agnostic
> ----------------------------------------------
>
>                 Key: BEAM-181
>                 URL: https://issues.apache.org/jira/browse/BEAM-181
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Thomas Groh
>            Priority: Minor
>
> PipelineOptions contains a tempLocation property, and IOChannelUtils should be capable
of handling arbitrary file locations that are used as a tempLocation. 
> The read and write tests for TextIO and AvroIO can use these properties to be written
in a runner-agnostic fashion, and then be marked as RunnableOnService. Doing so allows all
runners integrated with RunnableOnService to benefit from the existing tests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message