flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mihail Vieru <vi...@informatik.hu-berlin.de>
Subject Re: writeAsCsv not writing anything on HDFS when WriteMode set to OVERWRITE
Date Tue, 30 Jun 2015 10:10:53 GMT
Hi Till,

thank you for your reply.

I have the following code snippet:

/intermediateGraph.getVertices().writeAsCsv(tempGraphOutputPath, "\n", 
";", WriteMode.OVERWRITE);/

When I remove the WriteMode parameter, it works. So I can reason that 
the DataSet contains data elements.

Cheers,
Mihail


On 30.06.2015 12:06, Till Rohrmann wrote:
>
> Hi Mihail,
>
> have you checked that the |DataSet| you want to write to HDFS actually 
> contains data elements? You can try calling |collect| which retrieves 
> the data to your client to see what’s in there.
>
> Cheers,
> Till
>
> ​
>
> On Tue, Jun 30, 2015 at 12:01 PM, Mihail Vieru 
> <vieru@informatik.hu-berlin.de <mailto:vieru@informatik.hu-berlin.de>> 
> wrote:
>
>     Hi,
>
>     the writeAsCsv method is not writing anything to HDFS (version
>     1.2.1) when the WriteMode is set to OVERWRITE.
>     A file is created but it's empty. And no trace of errors in the
>     Flink or Hadoop logs on all nodes in the cluster.
>
>     What could cause this issue? I really really need this feature..
>
>     Best,
>     Mihail
>
>


Mime
View raw message