apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deepak Narkhede (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (APEXMALHAR-2314) Improper functioning in partitioning of sequencialFileRead property of FSRecordReader
Date Mon, 24 Oct 2016 08:44:58 GMT

     [ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Deepak Narkhede updated APEXMALHAR-2314:
----------------------------------------
    Description: 
Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly always
unique.
Hence unable to satisfy the sequencialFileRead property. Now the StreamCodec is modified to
work
with hashcode of filePath. So all blocks related to a file would be partitioned on same operator.

> Improper functioning in partitioning of sequencialFileRead property of FSRecordReader

> --------------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2314
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2314
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Deepak Narkhede
>            Assignee: Deepak Narkhede
>            Priority: Minor
>
> Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly
always unique.
> Hence unable to satisfy the sequencialFileRead property. Now the StreamCodec is modified
to work
> with hashcode of filePath. So all blocks related to a file would be partitioned on same
operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message