Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D889119E49 for ; Tue, 22 Mar 2016 11:32:17 +0000 (UTC) Received: (qmail 56265 invoked by uid 500); 22 Mar 2016 11:32:17 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 56177 invoked by uid 500); 22 Mar 2016 11:32:17 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 56168 invoked by uid 99); 22 Mar 2016 11:32:17 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Mar 2016 11:32:17 +0000 Received: from [192.168.1.110] (ip5b40315a.dynamic.kabel-deutschland.de [91.64.49.90]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 88B5B1A003F for ; Tue, 22 Mar 2016 11:32:16 +0000 (UTC) Subject: Re: override file in flink To: user@flink.apache.org References: From: Chesnay Schepler Message-ID: <56F12D52.2020204@apache.org> Date: Tue, 22 Mar 2016 12:32:34 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/alternative; boundary="------------060105000009070306010303" This is a multi-part message in MIME format. --------------060105000009070306010303 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit by using DataStream#writeAsCsv(String path, WriteMode writeMode) On 22.03.2016 12:18, subash basnet wrote: > Hello all, > > I am trying to write the streaming data to file and update it > recurrently with the streaming data. I get the following unable to > override exception error: > > *Caused by: java.io.IOException: File or directory already exists. > Existing files and directories are not overwritten in NO_OVERWRITE > mode. Use OVERWRITE mode to overwrite existing files and directories.* > at > org.apache.flink.core.fs.FileSystem.initOutPathLocalFS(FileSystem.java:594) > at > org.apache.flink.api.common.io.FileOutputFormat.open(FileOutputFormat.java:227) > at > org.apache.flink.api.java.io.CsvOutputFormat.open(CsvOutputFormat.java:160) > at > org.apache.flink.streaming.api.functions.sink.OutputFormatSinkFunction.open(OutputFormatSinkFunction.java:60) > at > org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:38) > at > org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:91) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:314) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:214) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) > at java.lang.Thread.run(Thread.java:745) > > > > How to set the necessary override property? > > Best Regards, > Subash Basnet > --------------060105000009070306010303 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit
by using DataStream#writeAsCsv(String path, WriteMode writeMode)

On 22.03.2016 12:18, subash basnet wrote:
Hello all,

I am trying to write the streaming data to file and update it recurrently with the streaming data. I get the following unable to override exception error:

Caused by: java.io.IOException: File or directory already exists. Existing files and directories are not overwritten in NO_OVERWRITE mode. Use OVERWRITE mode to overwrite existing files and directories.
at org.apache.flink.core.fs.FileSystem.initOutPathLocalFS(FileSystem.java:594)
at org.apache.flink.api.common.io.FileOutputFormat.open(FileOutputFormat.java:227)
at org.apache.flink.api.java.io.CsvOutputFormat.open(CsvOutputFormat.java:160)
at org.apache.flink.streaming.api.functions.sink.OutputFormatSinkFunction.open(OutputFormatSinkFunction.java:60)
at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:38)
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:91)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:314)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:214)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
at java.lang.Thread.run(Thread.java:745)



How to set the necessary override property?

Best Regards,
Subash Basnet


--------------060105000009070306010303--