Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4927F17E37 for ; Tue, 14 Apr 2015 18:45:52 +0000 (UTC) Received: (qmail 62310 invoked by uid 500); 14 Apr 2015 18:45:52 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 62249 invoked by uid 500); 14 Apr 2015 18:45:52 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 62240 invoked by uid 99); 14 Apr 2015 18:45:52 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Apr 2015 18:45:52 +0000 Received: from mail-wi0-f175.google.com (mail-wi0-f175.google.com [209.85.212.175]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 9FBF51A009B for ; Tue, 14 Apr 2015 18:45:51 +0000 (UTC) Received: by widjs5 with SMTP id js5so95055248wid.1 for ; Tue, 14 Apr 2015 11:45:50 -0700 (PDT) X-Received: by 10.194.179.38 with SMTP id dd6mr42846911wjc.149.1429037150068; Tue, 14 Apr 2015 11:45:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.185.81 with HTTP; Tue, 14 Apr 2015 11:45:29 -0700 (PDT) In-Reply-To: References: From: Robert Metzger Date: Tue, 14 Apr 2015 20:45:29 +0200 Message-ID: Subject: Re: Logging in Flink 0.9.0-milestone-1 To: "user@flink.apache.org" Content-Type: multipart/alternative; boundary=089e0141aa26b36a5d0513b3a3d7 --089e0141aa26b36a5d0513b3a3d7 Content-Type: text/plain; charset=UTF-8 Ah, I see. The issue is this line in the JobClient.scala here: https://github.com/apache/flink/blob/release-0.9.0-milestone-1-rc1/flink-runtime/src/main/scala/org/apache/flink/runtime/client/JobClient.scala#L97 As you can see, its doing sysout logging. In the current master, this has been reworked: https://github.com/apache/flink/blob/69a400fadd258fe0a1ff0b5670a3611fda4c1cdf/flink-runtime/src/main/java/org/apache/flink/runtime/client/JobClientActor.java#L60 (I'm currently looking up how to control the behavior) If its possible for you, you can switch to 0.9-SNAPSHOT. Best, Robert On Tue, Apr 14, 2015 at 7:02 PM, Stefan Bunk wrote: > Hi, > > I am also using IntelliJ, and I am starting directly from the IDE. Local > execution. > This is what my logging output looks like: [1]. > > I am getting my logger via: > val log = org.apache.log4j.Logger.getLogger(getClass) > > [1] https://gist.github.com/knub/1c11683601b4eeb5d51b > > On 14 April 2015 at 18:47, Robert Metzger wrote: > >> Hi, >> >> how are you starting Flink? Out of the IDE? Using the scripts? >> >> I just created a new flink project with the milestone version. Just >> putting your log4j.xml into the resources folder enabled the logging (I've >> set it to INFO for flink and it worked). >> I've used IntelliJ and started the WordCount.java from the quickstart. >> >> I think I need more details about your setup to reproduce the issue. >> >> >> >> >> On Tue, Apr 14, 2015 at 5:52 PM, Stefan Bunk >> wrote: >> >>> Hi Robert, >>> >>> thanks for the info. >>> Adding the parameter didn't help. My logging file is found and my >>> logging configuration for my own logging is working (even without the >>> parameter), it's just that the file in the jar seems to be preferred over >>> my file. >>> >>> Best, >>> Stefan >>> >>> On 14 April 2015 at 17:16, Robert Metzger wrote: >>> >>>> Hi Stefan, >>>> >>>> we made a stupid mistake in the 0.9.0-milestone-1 release by including >>>> our log4j.properties into the flink-runtime jar. its also in the fat jar in >>>> flink-dist. >>>> >>>> Maybe you can pass the name of your log4j file to your application with >>>> -Dlog4j.configuration=log4j.xml? >>>> >>>> The issue is already fixed in the current master but that doesn't help >>>> 0.9.0-milestone-1 users :( >>>> >>>> Best, >>>> Robert >>>> >>>> On Tue, Apr 14, 2015 at 4:49 PM, Stefan Bunk < >>>> stefan.bunk@googlemail.com> wrote: >>>> >>>>> Hi Flinkers, >>>>> >>>>> I just switched to 0.9.0-milestone-1, and now I get Flink's logging >>>>> output again in my console (local execution). >>>>> I have a log4j.xml under src/main/resources, which says not to log any >>>>> Flink job progress updates, and which worked fine so far: >>>>> >>>>> [...] >>>>> >>>>> >>>>> >>>>> >>>>> [...] >>>>> See the full file at [1]. >>>>> >>>>> However, this file seems to be ignored now. What do I need to change? >>>>> >>>>> Cheers >>>>> Stefan >>>>> >>>>> [1] https://gist.github.com/knub/bb1b3ffc6b47e2a1376d >>>>> >>>> >>>> >>> >> > --089e0141aa26b36a5d0513b3a3d7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Ah, I see.


As you ca= n see, its doing sysout logging.
(I= 9;m currently looking up how to control the behavior)

<= div>If its possible for you, you can switch to 0.9-SNAPSHOT.

=
Best,
Robert


On Tue, Apr 14, 2015 at 7:02 PM,= Stefan Bunk <stefan.bunk@googlemail.com> wrote:
Hi,

I a= m also using IntelliJ, and I am starting directly from the IDE. Local execu= tion.
This is what my logging output looks like: [1].

I am getting my logger via:
val log =3D org.apa= che.log4j.Logger.getLogger(getClass)


On 14 April 2015 at 18:47, Robert Metzger &l= t;rmetzger@apache.= org> wrote:
Hi,

how are you starting Flink? Out of the IDE? Using = the scripts?

I just created a new flink project wi= th the milestone version. Just putting your log4j.xml into the resources fo= lder enabled the logging (I've set it to INFO for flink and it worked).=
I've used IntelliJ and started the WordCount.java from the q= uickstart.

I think I need more details about your = setup to reproduce the issue.



<= /div>

On Tue, Apr 14, 2015 at 5:52 PM, Stefan Bunk <stefan.bunk@goo= glemail.com> wrote:
Hi Robert,

thanks for the info.
Addi= ng the parameter didn't help. My logging file is found and my logging c= onfiguration for my own logging is working (even without the parameter), it= 's just that the file in the jar seems to be preferred over my file.

Best,
Stefan

On 14 April 2015 at 17:16= , Robert Metzger <rmetzger@apache.org> wrote:
Hi Stefan,

we mad= e a stupid mistake in the 0.9.0-milestone-1 release by including our log4j.= properties into the flink-runtime jar. its also in the fat jar in flink-dis= t.

Maybe you can pass the name of your log4j file = to your application with=C2=A0-Dlog4j.configuration=3Dlog4j.xml?

The issue is already fixed in the current master but that doesn't hel= p 0.9.0-milestone-1 users :(

Best,
Rober= t

On Tue, Apr 14, 2015 at 4:49 PM, Stefan Bunk &= lt;stefan.b= unk@googlemail.com> wrote:
Hi Flinkers,

I just switched to 0.9.0-milestone-1, an= d now I get Flink's logging output again in my console (local execution= ).
I have a log4j.xml under src/main/resources, which says not to= log any Flink job progress updates, and which worked fine so far:

[...]
<logger name=3D= "org.apache.flink">
=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2= =A0=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0<level value=3D"ERROR" /&g= t;
=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0<appender-ref ref=3D"Console" />
</logger>
[...]
See the full file at [1].

However, this file seems to be ignored now. What do I nee= d to change?

Cheers
Stefan





--089e0141aa26b36a5d0513b3a3d7--