Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CAKBpmQpaXFS-OHn46XtEX0Bjkv+d9cj9tEWyLUpMm23oZRr5kw@mail.gmail.com>
References: <CAKBpmQqbamp3fwOcnmYax3-DTgm6WkDaTg0GuJoY73yvi2FuyQ@mail.gmail.com>
 <CANC1h_uxpm1NHG8dRkmOL9p31GTv_QWFjpAvV=X4EZr3uQ0h=Q@mail.gmail.com> <CAKBpmQpaXFS-OHn46XtEX0Bjkv+d9cj9tEWyLUpMm23oZRr5kw@mail.gmail.com>
From: Fabian Hueske <fhueske@gmail.com>
Date: Tue, 3 May 2016 11:10:07 +0200
Message-ID: <CAAdrtT3xO1cUWiCdxn4zMJUG8RjGff6zhPHgSRt=e4=w5H-Y8A@mail.gmail.com>
Subject: Re: Sink - writeAsText problem
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=bcaec50fe6dd6e8d4c0531ec7bed
archived-at: Tue, 03 May 2016 09:10:41 -0000

--bcaec50fe6dd6e8d4c0531ec7bed
Content-Type: text/plain; charset=UTF-8

Yes, but be aware that your program runs with parallelism 1 if you do not
configure the parallelism.

2016-05-03 11:07 GMT+02:00 Punit Naik <naik.punit44@gmail.com>:

> Hi Stephen, Fabian
>
> setting "fs.output.always-create-directory" to true in flink-config.yml
> worked!
>
> On Tue, May 3, 2016 at 2:27 PM, Stephan Ewen <sewen@apache.org> wrote:
>
>> Hi!
>>
>> There is the option to always create a directory:
>> "fs.output.always-create-directory"
>>
>> See
>> https://ci.apache.org/projects/flink/flink-docs-release-1.0/setup/config.html#file-systems
>>
>> Greetings,
>> Stephan
>>
>>
>> On Tue, May 3, 2016 at 9:26 AM, Punit Naik <naik.punit44@gmail.com>
>> wrote:
>>
>>> Hello
>>>
>>> I executed my Flink code in eclipse and it properly generated the output
>>> by creating a folder (as specified in the string) and placing output files
>>> in them.
>>>
>>> But when I exported the project as JAR and ran the same code using
>>> ./flink run, it generated the output, but instead of creating a folder with
>>> files in it, it just created a single file (as specified in the string)
>>> (output was correct though).
>>>
>>> Why does this happen? I want Flink to write its output in folder.
>>>
>>> --
>>> Thank You
>>>
>>> Regards
>>>
>>> Punit Naik
>>>
>>
>>
>
>
> --
> Thank You
>
> Regards
>
> Punit Naik
>

--bcaec50fe6dd6e8d4c0531ec7bed
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Yes, but be aware that your program runs with parallelism =
1 if you do not configure the parallelism.<br></div><div class=3D"gmail_ext=
ra"><br><div class=3D"gmail_quote">2016-05-03 11:07 GMT+02:00 Punit Naik <s=
pan dir=3D"ltr">&lt;<a href=3D"mailto:naik.punit44@gmail.com" target=3D"_bl=
ank">naik.punit44@gmail.com</a>&gt;</span>:<br><blockquote class=3D"gmail_q=
uote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1e=
x"><div dir=3D"ltr"><div>Hi Stephen, Fabian<br><br></div>setting &quot;fs.o=
utput.always-create-directory&quot; to true in flink-config.yml worked!<br>=
</div><div class=3D"HOEnZb"><div class=3D"h5"><div class=3D"gmail_extra"><b=
r><div class=3D"gmail_quote">On Tue, May 3, 2016 at 2:27 PM, Stephan Ewen <=
span dir=3D"ltr">&lt;<a href=3D"mailto:sewen@apache.org" target=3D"_blank">=
sewen@apache.org</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote"=
 style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><d=
iv dir=3D"ltr">Hi!<div><br></div>There is the option to always create a dir=
ectory: &quot;fs.output.always-create-directory&quot;<br><br>See <a href=3D=
"https://ci.apache.org/projects/flink/flink-docs-release-1.0/setup/config.h=
tml#file-systems" target=3D"_blank">https://ci.apache.org/projects/flink/fl=
ink-docs-release-1.0/setup/config.html#file-systems</a><br><br>Greetings,<b=
r>Stephan<div><font face=3D"Menlo, Lucida Console, monospace" color=3D"#000=
000"><span style=3D"font-size:12.6px;line-height:18px"><br></span></font></=
div></div><div><div><div class=3D"gmail_extra"><br><div class=3D"gmail_quot=
e">On Tue, May 3, 2016 at 9:26 AM, Punit Naik <span dir=3D"ltr">&lt;<a href=
=3D"mailto:naik.punit44@gmail.com" target=3D"_blank">naik.punit44@gmail.com=
</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin=
:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><=
div><div><div>Hello<br><br></div>I executed my Flink code in eclipse and it=
 properly generated the output by creating a folder (as specified in the st=
ring) and placing output files in them.<br><br></div>But when I exported th=
e project as JAR and ran the same code using ./flink run, it generated the =
output, but instead of creating a folder with files in it, it just created =
a single file (as specified in the string) (output was correct though).<br>=
<br></div>Why does this happen? I want Flink to write its output in folder.=
<span><font color=3D"#888888"><br clear=3D"all"><div><div><div><div><br>-- =
<br><div><div dir=3D"ltr"><div><div>Thank You<br><br></div>Regards<br><br><=
/div>Punit Naik<br></div></div>
</div></div></div></div></font></span></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br><br clear=3D"all"><br>-- <br><div><div d=
ir=3D"ltr"><div><div>Thank You<br><br></div>Regards<br><br></div>Punit Naik=
<br></div></div>
</div>
</div></div></blockquote></div><br></div>

--bcaec50fe6dd6e8d4c0531ec7bed--