beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jozef Vilcek (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-4861) Hadoop Filesystem silently fails
Date Wed, 25 Jul 2018 14:08:00 GMT
Jozef Vilcek created BEAM-4861:
----------------------------------

             Summary: Hadoop Filesystem silently fails
                 Key: BEAM-4861
                 URL: https://issues.apache.org/jira/browse/BEAM-4861
             Project: Beam
          Issue Type: Bug
          Components: io-java-hadoop
            Reporter: Jozef Vilcek
            Assignee: Chamikara Jayalath


Hi,

beam Filesystem operations copy, rename and delete are void in SDK. Hadoop native filesystem
operations are not and returns void. Current implementation in Beam ignores the result and
pass as long as exception is not thrown.

My question is, if this is by design or a bug.

I got burned by this when using 'rename' to do a 'move' operation on HDFS. If target directory
does not exists, operations returns false and do not touch the file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message