systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (SYSTEMML-1697) Reading multi-part files w/o existing directory from object store
Date Sun, 18 Jun 2017 20:57:02 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm closed SYSTEMML-1697.
------------------------------------

> Reading multi-part files w/o existing directory from object store
> -----------------------------------------------------------------
>
>                 Key: SYSTEMML-1697
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1697
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 1.0
>
>
> Assume a multi-part binary matrix written to an object store. As the object store only
emulates a directory structure, the parent directory does not exist. Accordingly, our binary
block matrix readers (which directly read from sequence files instead of record readers) fail
because the check for {{isDirectory}} returns false. In order to fix this, we would need to
be aware of this issues and handle it when ran against object store file schemes. Similarly,
{{listStatus}} also returns the meta data file which has the same prefix as the created "directory"
and needs to be filtered out.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message