flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <fhue...@gmail.com>
Subject Re: HDFS directory rename
Date Fri, 17 Jul 2015 08:08:31 GMT
Do you want to move the folder within a running job? This might cause a lot of problems, because
you cannot (easily) control when a move command would be executed.

Wouldn’t it be a better idea to do that after a job is finished and use the regular HDFS

From: Flavio Pompermaier
Sent: ‎Friday‎, ‎17‎. ‎July‎, ‎2015 ‎10‎:‎02
To: user@flink.apache.org

Hi to all,

in my Flink job I wanted to move a folder (containing other folders and files) to another

For example, I wanted to move folder A to folder Y, where my HDFS looks like:




I tried to use rename but it silently fails (rename just returns false) if the parent directory
doesn't exists.

Is there an easy way to do that with the Flink FS apis?

If the rename() is intended to work that way, couldn't be useful a move() API..?


View raw message