Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6637B200B6D for ; Wed, 24 Aug 2016 00:03:40 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 60658160AC6; Tue, 23 Aug 2016 22:03:30 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A44F4160AAD for ; Wed, 24 Aug 2016 00:03:29 +0200 (CEST) Received: (qmail 20979 invoked by uid 500); 23 Aug 2016 22:03:23 -0000 Mailing-List: contact dev-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.apache.org Delivered-To: mailing list dev@apex.apache.org Received: (qmail 20968 invoked by uid 99); 23 Aug 2016 22:03:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2016 22:03:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 62202CB663 for ; Tue, 23 Aug 2016 22:03:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.739 X-Spam-Level: X-Spam-Status: No, score=-3.739 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.519] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 4i5uGXUBtNEv for ; Tue, 23 Aug 2016 22:03:22 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 5DD005FBD3 for ; Tue, 23 Aug 2016 22:03:21 +0000 (UTC) Received: (qmail 20830 invoked by uid 99); 23 Aug 2016 22:03:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2016 22:03:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 848B02C0153 for ; Tue, 23 Aug 2016 22:03:20 +0000 (UTC) Date: Tue, 23 Aug 2016 22:03:20 +0000 (UTC) From: "Thomas Weise (JIRA)" To: dev@apex.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (APEXMALHAR-2148) Reduce the noise of kafka input operator MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 23 Aug 2016 22:03:40 -0000 [ https://issues.apache.org/jira/browse/APEXMALHAR-2148?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXMALHAR-2148. -------------------------------------- Resolution: Fixed > Reduce the noise of kafka input operator > ---------------------------------------- > > Key: APEXMALHAR-2148 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-214= 8 > Project: Apache Apex Malhar > Issue Type: Improvement > Reporter: Siyuan Hua > Assignee: Siyuan Hua > Fix For: 3.5.0 > > > Acceptance Criteria: > Reduce logging level > =E2=80=94 > Even when there are no tuples flowing, the Kafka input operator generates= a lot of noise in the logs as shown below; at the lease the config values = should be switched to DEBUG level. > ------------------------------------- > 2016-04-23 14:16:49,179 INFO org.apache.kafka.common.utils.AppInfoParser:= Kafka version : 0.9.0.1 > 2016-04-23 14:16:49,179 INFO org.apache.kafka.common.utils.AppInfoParser:= Kafka commitId : 23c69d62a0cabf06 > 2016-04-23 14:16:49,296 INFO com.datatorrent.stram.FSRecoveryHandler: Cre= ating hdfs://localhost:9000/user/dtadmin/datatorrent/apps/application_14614= 43973082_0002/recovery/log016-04-23 14:17:19,460 INFO org.apache.kafka.clie= nts.consumer.ConsumerConfig: ConsumerConfig values: > request.timeout.ms =3D 40000 > check.crcs =3D true > retry.backoff.ms =3D 100 > ssl.truststore.password =3D null > ssl.keymanager.algorithm =3D SunX509 > receive.buffer.bytes =3D 32768 > ssl.cipher.suites =3D null > ssl.key.password =3D null > sasl.kerberos.ticket.renew.jitter =3D 0.05 > ssl.provider =3D null > sasl.kerberos.service.name =3D null > session.timeout.ms =3D 30000 > sasl.kerberos.ticket.renew.window.factor =3D 0.8 > bootstrap.servers =3D [localhost:9092] > client.id =3D > fetch.max.wait.ms =3D 500 > fetch.min.bytes =3D 1 > key.deserializer =3D class org.apache.kafka.common.serialization.ByteArra= yDeserializer > sasl.kerberos.kinit.cmd =3D /usr/bin/kinit > auto.offset.reset =3D latest > value.deserializer =3D class org.apache.kafka.common.serialization.ByteAr= rayDeserializer > ssl.enabled.protocols =3D [TLSv1.2, TLSv1.1, TLSv1] > partition.assignment.strategy =3D [org.apache.kafka.clients.consumer.Rang= eAssignor] > ssl.endpoint.identification.algorithm =3D null > max.partition.fetch.bytes =3D 1048576 > ssl.keystore.location =3D null > ssl.truststore.location =3D null > ssl.keystore.password =3D null > metrics.sample.window.ms =3D 30000 > metadata.max.age.ms =3D 300000 > security.protocol =3D PLAINTEXT > auto.commit.interval.ms =3D 5000 > ssl.protocol =3D TLS > sasl.kerberos.min.time.before.relogin =3D 60000 > connections.max.idle.ms =3D 540000 > ssl.trustmanager.algorithm =3D PKIX > group.id =3D org.apache.apex.malhar.kafka.AbstractKafkaInputOperatorMETA_= GROUP > enable.auto.commit =3D false > metric.reporters =3D [] > ssl.truststore.type =3D JKS > send.buffer.bytes =3D 131072 > reconnect.backoff.ms =3D 50 > metrics.num.samples =3D 2 > ssl.keystore.type =3D JKS > heartbeat.interval.ms =3D 3000 -- This message was sent by Atlassian JIRA (v6.3.4#6332)