flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Punit Naik <naik.puni...@gmail.com>
Subject Re: Sink - writeAsText problem
Date Tue, 03 May 2016 11:25:41 GMT
Yeah thanks for letting me know.
On 03-May-2016 2:40 PM, "Fabian Hueske" <fhueske@gmail.com> wrote:

> Yes, but be aware that your program runs with parallelism 1 if you do not
> configure the parallelism.
>
> 2016-05-03 11:07 GMT+02:00 Punit Naik <naik.punit44@gmail.com>:
>
>> Hi Stephen, Fabian
>>
>> setting "fs.output.always-create-directory" to true in flink-config.yml
>> worked!
>>
>> On Tue, May 3, 2016 at 2:27 PM, Stephan Ewen <sewen@apache.org> wrote:
>>
>>> Hi!
>>>
>>> There is the option to always create a directory:
>>> "fs.output.always-create-directory"
>>>
>>> See
>>> https://ci.apache.org/projects/flink/flink-docs-release-1.0/setup/config.html#file-systems
>>>
>>> Greetings,
>>> Stephan
>>>
>>>
>>> On Tue, May 3, 2016 at 9:26 AM, Punit Naik <naik.punit44@gmail.com>
>>> wrote:
>>>
>>>> Hello
>>>>
>>>> I executed my Flink code in eclipse and it properly generated the
>>>> output by creating a folder (as specified in the string) and placing output
>>>> files in them.
>>>>
>>>> But when I exported the project as JAR and ran the same code using
>>>> ./flink run, it generated the output, but instead of creating a folder with
>>>> files in it, it just created a single file (as specified in the string)
>>>> (output was correct though).
>>>>
>>>> Why does this happen? I want Flink to write its output in folder.
>>>>
>>>> --
>>>> Thank You
>>>>
>>>> Regards
>>>>
>>>> Punit Naik
>>>>
>>>
>>>
>>
>>
>> --
>> Thank You
>>
>> Regards
>>
>> Punit Naik
>>
>
>

Mime
View raw message