apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Weise (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2272) sequencialFileRead property on FSInputModule not functioning as expected
Date Wed, 28 Sep 2016 23:38:20 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531246#comment-15531246
] 

Thomas Weise commented on APEXMALHAR-2272:
------------------------------------------

Why was the operator not marked evolving when it was added? I don't think it's the first time
we run into this issue. It would also be nice if such things are caught during code review...


> sequencialFileRead property on FSInputModule not functioning as expected
> ------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2272
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2272
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Yogi Devendra
>            Assignee: Yogi Devendra
>            Priority: Minor
>
> When there is single large file in the input directory, and we have multiple partitions
for BlockReader and sequencialFileRead is set to true.
> Only one BlockReader instance should be active; other BlockReader instances should remain
idle.
> This is because sequencialFileRead makes sure that blocks of the file are read serially
by same BlockReader instance. 
> Observed behavior is all BlockReader instances are reading data which means sequencialFileRead
property is not functioning as expected.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message