apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Munagala V. Ramanath (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2272) sequencialFileRead property on FSInputModule is functioning as expected
Date Wed, 28 Sep 2016 14:45:20 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529874#comment-15529874

Munagala V. Ramanath commented on APEXMALHAR-2272:

sequencial => sequential {2 files: FSInputModule.java, S3InputModule.java}

> sequencialFileRead property on FSInputModule is functioning as expected
> -----------------------------------------------------------------------
>                 Key: APEXMALHAR-2272
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2272
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Yogi Devendra
>            Priority: Minor
> When there is single large file in the input directory, and we have multiple partitions
for BlockReader and sequencialFileRead is set to true.
> Only one BlockReader instance should be active; other BlockReader instances should remain
> This is because sequencialFileRead makes sure that blocks of the file are read serially
by same BlockReader instance. 
> Observed behavior is all BlockReader instances are reading data which means sequencialFileRead
property is not functioning as expected.

This message was sent by Atlassian JIRA

View raw message