Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AD79B200D1E for ; Wed, 18 Oct 2017 20:32:48 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id AC2FA1609DE; Wed, 18 Oct 2017 18:32:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id ACB7D160BEA for ; Wed, 18 Oct 2017 20:32:47 +0200 (CEST) Received: (qmail 74457 invoked by uid 500); 18 Oct 2017 18:32:46 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 74446 invoked by uid 99); 18 Oct 2017 18:32:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Oct 2017 18:32:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id C324CC1E08 for ; Wed, 18 Oct 2017 18:32:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.048 X-Spam-Level: X-Spam-Status: No, score=-0.048 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, KAM_LOTSOFHASH=0.25, KAM_SHORT=0.001, NORMAL_HTTP_TO_IP=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.8, RCVD_IN_SORBS_SPAM=0.5] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=intellifylearning-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id bmEs8VU-KP_J for ; Wed, 18 Oct 2017 18:32:43 +0000 (UTC) Received: from mail-qk0-f176.google.com (mail-qk0-f176.google.com [209.85.220.176]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id A05485F6C8 for ; Wed, 18 Oct 2017 18:32:42 +0000 (UTC) Received: by mail-qk0-f176.google.com with SMTP id o187so7436901qke.7 for ; Wed, 18 Oct 2017 11:32:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intellifylearning-com.20150623.gappssmtp.com; s=20150623; h=from:mime-version:subject:message-id:date:to; bh=B3QfajihgAp7wxC+58G7IgeXAzVxVJODqvgNxIDtCYY=; b=1fikHaLnA/GUbCMD4+XeUJHAWoIThUCbC/noE/WuDYNhUXmMpOhJOBncdHAFcLX872 lPQ3KhGm+aYB7seMa6GTI4T5jMAjc4y7JpTWmsWMm6R99gdKOdwJ58Kez7GOiPdYYBmd Uxt4EKOQ1/TWO60AOjiBkHcK8+maQCeNAIyMYmiIki9+w0de93sW0ufFPq4PKRa+ZUV4 k7V8iGqj29A+EuSF3mcKL2I4Upm9fprqCza1GtgpLPi09pqspTlaLqG7jKwg33+ITvMr 3LTJrRijIA8NXnQTu/oNtURecS1tpFeZbPQ4S2J2i1irLY2oVe7uR21ks/Hi9iHa+P0O E37g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:subject:message-id:date:to; bh=B3QfajihgAp7wxC+58G7IgeXAzVxVJODqvgNxIDtCYY=; b=JfRbB7u7GBx+halqKYNyHENX0e8RnevhmcaYs5ZhSY2W6RziiMsSewXfAyS88J79tu 6pBhZd7SjbfHhKtmzKfNMobW9sLLYdjetJiH13fxKmLUzvVxJljfvijiYF7HGE28MhmV atk5U7EbHEeifIssDn8yDS9uPNv9r52mCiYQ/BdyWjF2eDIOGASMMISr/X0EfOe/DWZA 2dw80aUZYrMhZ5grWmpcHh6/UhMXSmye/TJlQKvFaprU5OLycSWxgvfmpsVqzuWvwBLp /dpqgdomtMOdxi1quaN2VmHilrINGe7upfehdE7pzMJHJqa/urCbPxujpIiB6+h3vZCP i6MQ== X-Gm-Message-State: AMCzsaXuMz4+/9lK+V7FoVArKlUdv5xId/SH16b4OF4s0VdFc1KbdYDs leM5GqOvfggFfyBxajr8lCnSH5YIGw== X-Google-Smtp-Source: ABhQp+SeaRTx/K8xxyP5NWJWZbtQGQw1IrwrLCtsj2ws0pW7VFXHwDhCQIgw58srhiy+v8ShEeIiQA== X-Received: by 10.55.21.30 with SMTP id f30mr3973654qkh.335.1508351561248; Wed, 18 Oct 2017 11:32:41 -0700 (PDT) Received: from [10.13.106.124] ([157.130.220.250]) by smtp.gmail.com with ESMTPSA id l207sm4629943qke.97.2017.10.18.11.32.40 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 18 Oct 2017 11:32:40 -0700 (PDT) From: Jared Stehler Content-Type: multipart/alternative; boundary="Apple-Mail=_2408BF98-AA47-4782-8910-FABC2D3E47AC" Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: SLF4j logging system gets clobbered? Message-Id: <66283A8D-C241-4CA0-9B28-7823C9B175A4@intellifylearning.com> Date: Wed, 18 Oct 2017 14:32:40 -0400 To: user@flink.apache.org X-Mailer: Apple Mail (2.3273) archived-at: Wed, 18 Oct 2017 18:32:48 -0000 --Apple-Mail=_2408BF98-AA47-4782-8910-FABC2D3E47AC Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I=E2=80=99m having an issue where I=E2=80=99ve got logging setup and = functioning for my flink-mesos deployment, and works fine up to a point = (the same point every time) where it seems to fall back to = =E2=80=9Cdefaults=E2=80=9D and loses all of my configured filtering. 2017-10-11 21:37:17.454 [flink-akka.actor.default-dispatcher-17] INFO = o.a.f.m.runtime.clusterframework.MesosFlinkResourceManager - = TaskManager taskmanager-00008 has started. 2017-10-11 21:37:17.454 [flink-akka.actor.default-dispatcher-16] INFO = org.apache.flink.runtime.instance.InstanceManager - Registered = TaskManager at ip-10-80-54-201 = (akka.tcp://flink@ip-10-80-54-201.us-west-2.compute.internal:31014/user/ta= skmanager) as 697add78bd00fe7dc6a7aa60bc8d75fb. Current number of = registered hosts is 39. Current number of alive task slots is 39. 2017-10-11 21:37:18.820 [flink-akka.actor.default-dispatcher-17] INFO = org.apache.flink.runtime.instance.InstanceManager - Registered = TaskManager at ip-10-80-54-201 = (akka.tcp://flink@ip-10-80-54-201.us-west-2.compute.internal:31018/user/ta= skmanager) as a6cff0f18d71aabfb3b112f5e2c36c2b. Current number of = registered hosts is 40. Current number of alive task slots is 40. 2017-10-11 21:37:18.821 [flink-akka.actor.default-dispatcher-17] INFO = o.a.f.m.runtime.clusterframework.MesosFlinkResourceManager - = TaskManager taskmanager-00010 has started. 2017-10-11 = 21:39:04,371:6171(0x7f67fe9cd700):ZOO_WARN@zookeeper_interest@1570: = Exceeded deadline by 13ms =E2=80=94 here is where it turns over into default pattern layout --- 21:39:05.616 [nioEventLoopGroup-5-6] INFO = o.a.flink.runtime.blob.BlobClient - Blob client connecting to = akka://flink/user/jobmanager 21:39:09.322 [nioEventLoopGroup-5-6] INFO = o.a.flink.runtime.client.JobClient - Checking and uploading JAR files 21:39:09.322 [nioEventLoopGroup-5-6] INFO = o.a.flink.runtime.blob.BlobClient - Blob client connecting to = akka://flink/user/jobmanager 21:39:09.788 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.m.r.c.MesosJobManager - Submitting job = 005b570ff2866023aa905f2bc850f7a3 (Sa-As-2b-Submission-Join-V3 :=3D = demos-demo500--data-canvas-2-sa-qs-as-v3). 21:39:09.789 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.m.r.c.MesosJobManager - Using restart strategy = FailureRateRestartStrategy(failuresInterval=3D120000 = msdelayInterval=3D1000 msmaxFailuresPerInterval=3D3) for = 005b570ff2866023aa905f2bc850f7a3. 21:39:09.789 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.r.e.ExecutionGraph - Job recovers via failover strategy: full = graph restart 21:39:09.790 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.m.r.c.MesosJobManager - Running initialization on master for job = Sa-As-2b-Submission-Join-V3 :=3D = demos-demo500--data-canvas-2-sa-qs-as-v3 = (005b570ff2866023aa905f2bc850f7a3). 21:39:09.790 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.m.r.c.MesosJobManager - Successfully ran initialization on master = in 0 ms. 21:39:09.791 [flink-akka.actor.default-dispatcher-4] WARN = o.a.f.configuration.Configuration - Config uses deprecated configuration = key 'high-availability.zookeeper.storageDir' instead of proper key = 'high-availability.storageDir' 21:39:09.791 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.failover-timeout, 60 21:39:09.791 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.initial-tasks, 1 21:39:09.791 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.maximum-failed-tasks, -1 21:39:09.791 [flink-akka.actor.default-dispatcher-4] INFO = o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.resourcemanager.framework.role, '*' The reason this is a vexing issue is that the app master then proceeds = to dump megabytes of " o.a.f.c.GlobalConfiguration - Loading = configuration property:=E2=80=9D messages into the log, and I=E2=80=99m = unable to filter them out. My logback config is: %d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level = %logger{60} %X{sourceThread} - %msg%n ERROR -- Jared Stehler Chief Architect - Intellify Learning o: 617.701.6330 x703 --Apple-Mail=_2408BF98-AA47-4782-8910-FABC2D3E47AC Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
I=E2=80=99m having an issue where I=E2=80=99ve = got logging setup and functioning for my flink-mesos deployment, and = works fine up to a point (the same point every time) where it seems to = fall back to =E2=80=9Cdefaults=E2=80=9D and loses all of my configured = filtering.

2017-10-11 21:37:17.454 = [flink-akka.actor.default-dispatcher-17] INFO =  o.a.f.m.runtime.clusterframework.MesosFlinkResourceManager  - = TaskManager taskmanager-00008 has started.
2017-10-11= 21:37:17.454 [flink-akka.actor.default-dispatcher-16] INFO =  org.apache.flink.runtime.instance.InstanceManager  - = Registered TaskManager at ip-10-80-54-201 (akka.tcp://flink@ip-10-80-54-201.us-west-2.compute.internal:310= 14/user/taskmanager) as 697add78bd00fe7dc6a7aa60bc8d75fb. Current = number of registered hosts is 39. Current number of alive task slots is = 39.
2017-10-11 21:37:18.820 = [flink-akka.actor.default-dispatcher-17] INFO =  org.apache.flink.runtime.instance.InstanceManager  - = Registered TaskManager at ip-10-80-54-201 (akka.tcp://flink@ip-10-80-54-201.us-west-2.compute.internal:310= 18/user/taskmanager) as a6cff0f18d71aabfb3b112f5e2c36c2b. Current = number of registered hosts is 40. Current number of alive task slots is = 40.
2017-10-11 21:37:18.821 = [flink-akka.actor.default-dispatcher-17] INFO =  o.a.f.m.runtime.clusterframework.MesosFlinkResourceManager  - = TaskManager taskmanager-00010 has started.
2017-10-11= 21:39:04,371:6171(0x7f67fe9cd700):ZOO_WARN@zookeeper_interest@1570: = Exceeded deadline by 13ms

=E2=80=94 here is where it turns over into default pattern = layout ---
21:39:05.616 = [nioEventLoopGroup-5-6] INFO  o.a.flink.runtime.blob.BlobClient - = Blob client connecting to akka://flink/user/jobmanager

21:39:09.322 [nioEventLoopGroup-5-6] = INFO  o.a.flink.runtime.client.JobClient - Checking and uploading = JAR files
21:39:09.322 [nioEventLoopGroup-5-6] INFO =  o.a.flink.runtime.blob.BlobClient - Blob client connecting to akka://flink/user/jobmanager
21:39:09.788 [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.m.r.c.MesosJobManager - Submitting job = 005b570ff2866023aa905f2bc850f7a3 (Sa-As-2b-Submission-Join-V3 :=3D = demos-demo500--data-canvas-2-sa-qs-as-v3).
21:39:09.789 [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.m.r.c.MesosJobManager - Using restart strategy = FailureRateRestartStrategy(failuresInterval=3D120000 = msdelayInterval=3D1000 msmaxFailuresPerInterval=3D3) for = 005b570ff2866023aa905f2bc850f7a3.
21:39:09.789 = [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.r.e.ExecutionGraph - Job recovers via failover strategy: = full graph restart
21:39:09.790 = [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.m.r.c.MesosJobManager - Running initialization on master for = job Sa-As-2b-Submission-Join-V3 :=3D = demos-demo500--data-canvas-2-sa-qs-as-v3 = (005b570ff2866023aa905f2bc850f7a3).
21:39:09.790 = [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.m.r.c.MesosJobManager - Successfully ran initialization on = master in 0 ms.
21:39:09.791 = [flink-akka.actor.default-dispatcher-4] WARN =  o.a.f.configuration.Configuration - Config uses deprecated = configuration key 'high-availability.zookeeper.storageDir' instead of = proper key 'high-availability.storageDir'
21:39:09.791 [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.failover-timeout, 60
21:39:09.791 = [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.initial-tasks, 1
21:39:09.791 = [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.maximum-failed-tasks, -1
21:39:09.791 = [flink-akka.actor.default-dispatcher-4] INFO =  o.a.f.c.GlobalConfiguration - Loading configuration property: = mesos.resourcemanager.framework.role, '*'

The reason this is a vexing issue is = that the app master then proceeds to dump megabytes of " = o.a.f.c.GlobalConfiguration - Loading configuration property:=E2=80=9D = messages into the log, and I=E2=80=99m unable to filter them = out.

My = logback config is:

<?xml version=3D"1.0" = encoding=3D"UTF-8"?>
<configuration = debug=3D"true">
    <appender = name=3D"CONSOLE" = class=3D"ch.qos.logback.core.ConsoleAppender">
        <encoder>
            = <pattern>%d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level = %logger{60} %X{sourceThread} - %msg%n</pattern>
        </encoder>
    </appender>

    <appender = name=3D"SENTRY" class=3D"io.sentry.logback.SentryAppender">
        <filter = class=3D"ch.qos.logback.classic.filter.ThresholdFilter">
            = <level>ERROR</level>
    =     </filter>
    = </appender>

    <logger = name=3D"org.apache.flink.runtime.metrics.MetricRegistry" level=3D"OFF" = />
    <logger = name=3D"org.apache.kafka.clients.ClientUtils" level=3D"OFF" = />
    <logger = name=3D"org.apache.flink.runtime.webmonitor.files.StaticFileServerHandler"= level=3D"OFF" />
    <logger = name=3D"org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchS= inkBase" level=3D"OFF" />

    <logger = name=3D"org.apache.flink.configuration.GlobalConfiguration" level=3D"WARN"= />
    <logger = name=3D"org.apache.flink.runtime.checkpoint.CheckpointCoordinator" = level=3D"WARN" />

    <logger = name=3D"org.elasticsearch.client.transport" level=3D"DEBUG" = />

  =   <root level=3D"INFO">
    =     <appender-ref ref=3D"CONSOLE" />
        <appender-ref ref=3D"SENTRY" = />
    </root>
</configuration>



--
Jared Stehler
Chief Architect - = Intellify Learning
o: 617.701.6330 x703



= --Apple-Mail=_2408BF98-AA47-4782-8910-FABC2D3E47AC--