Return-Path: X-Original-To: apmail-ambari-user-archive@www.apache.org Delivered-To: apmail-ambari-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B5C5018DD8 for ; Wed, 23 Sep 2015 16:25:12 +0000 (UTC) Received: (qmail 32227 invoked by uid 500); 23 Sep 2015 16:25:12 -0000 Delivered-To: apmail-ambari-user-archive@ambari.apache.org Received: (qmail 32198 invoked by uid 500); 23 Sep 2015 16:25:12 -0000 Mailing-List: contact user-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ambari.apache.org Delivered-To: mailing list user@ambari.apache.org Received: (qmail 32188 invoked by uid 99); 23 Sep 2015 16:25:12 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Sep 2015 16:25:12 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id F0A0D183E42 for ; Wed, 23 Sep 2015 16:25:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 5 X-Spam-Level: ***** X-Spam-Status: No, score=5 tagged_above=-999 required=6.31 tests=[FSL_HELO_BARE_IP_2=1.999, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id TLG-5Z2iaFmo for ; Wed, 23 Sep 2015 16:25:02 +0000 (UTC) Received: from relayvx12c.securemail.intermedia.net (relayvx12c.securemail.intermedia.net [64.78.52.187]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 10160237B8 for ; Wed, 23 Sep 2015 16:25:02 +0000 (UTC) Received: from securemail.intermedia.net (localhost [127.0.0.1]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id B84BA53E9B; Wed, 23 Sep 2015 09:25:01 -0700 (PDT) Subject: Re: Couldn't change value of kafka.metrics.reporters MIME-Version: 1.0 x-echoworx-msg-id: 53355ab6-fc60-49cb-88b1-f7b794026323 x-echoworx-emg-received: Wed, 23 Sep 2015 09:25:01.730 -0700 x-echoworx-action: delivered Received: from 10.254.155.17 ([10.254.155.17]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 315; Wed, 23 Sep 2015 09:25:01 -0700 (PDT) Received: from MBX080-W4-CO-1.exch080.serverpod.net (unknown [10.224.117.101]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id 7B96C53E9B; Wed, 23 Sep 2015 09:25:01 -0700 (PDT) Received: from MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) by MBX080-W4-CO-1.exch080.serverpod.net (10.224.117.101) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Wed, 23 Sep 2015 09:25:00 -0700 Received: from MBX080-W4-CO-2.exch080.serverpod.net ([10.224.117.102]) by mbx080-w4-co-2.exch080.serverpod.net ([10.224.117.102]) with mapi id 15.00.1044.021; Wed, 23 Sep 2015 09:25:00 -0700 From: Dmitry Sen To: "user@ambari.apache.org" , Sriharsha Chintalapani , "coooldrw@gmail.com" Thread-Topic: Couldn't change value of kafka.metrics.reporters Thread-Index: AQHQ9djI2Hm9dKUSIEyyOgn4fDvy+55Ks8UAgAAAHYD//5dhRQ== Date: Wed, 23 Sep 2015 16:25:00 +0000 Message-ID: <1443025499806.10151@hortonworks.com> References: , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [109.86.55.247] x-source-routing-agent: Processed Content-Type: multipart/alternative; boundary="_000_144302549980610151hortonworkscom_" --_000_144302549980610151hortonworkscom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Is looks like a bug, whatever you set as value for kafka.metrics.reporters = , it's overridden by ambari agent /var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/scripts= /kafka.py:57 kafka_server_config['kafka.metrics.reporters'] =3D params.kafka_metrics= _reporters ? As a hack , you can try to set your value in params.py on all hosts /var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/scripts= /params.py:103 kafka_metrics_reporters =3D kafka_metrics_reporters + "org.apache.hadoop.= metrics2.sink.kafka.KafkaTimelineMetricsReporter" ? ________________________________ From: Alejandro Fernandez Sent: Wednesday, September 23, 2015 6:32 PM To: user@ambari.apache.org; Sriharsha Chintalapani; coooldrw@gmail.com Subject: Re: Couldn't change value of kafka.metrics.reporters From: Alejandro Fernandez > Date: Wednesday, September 23, 2015 at 8:32 AM To: "user@ambari.apache.org" >, Sriharsha Chintalapani > Subject: Re: Couldn't change value of kafka.metrics.reporters cc Sriharsha From: Darwin Wirawan > Reply-To: "user@ambari.apache.org" > Date: Wednesday, September 23, 2015 at 1:20 AM To: "user@ambari.apache.org" > Subject: Couldn't change value of kafka.metrics.reporters Hello Ambari Team, I'm using ambari 2.0, and now I'm trying to configure Kafka so she could s= end metric via kafka-graphite. I'm new to monitoring or metrics thing, I tr= ied to figure out what is metrics.reporter? And also, why I can't change kafka.metrics.reporters in my kafka configurat= ion? I changed it via ambari but when I check kafka.properties, the value s= till in default (org.apache.hadoop.metrics2.sink.kafka.KafkaTimelineMetrics= Reporter). Is there any way so I can change my kafka.metrics.reporters? Another question, I found my kafka has some metrics, I guess my Ambari Metr= ics is running OK. Can I pass that metrics to graphite? Or somehow change t= he destination to my graphite server? Thanks, Darwin --_000_144302549980610151hortonworkscom_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

Is looks like a bug, wha= tever you set as value for kafka.metrics.reporters , it's overridden by ambari agent

/var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/scri= pts/kafka.py:57

    kafka_server_config['kafka.metrics.reporters'] =3D param= s.kafka_metrics_reporters

​
As a hack , you can try to set your value in params.py on all hos= ts
/var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/sc= ripts/params.py:103
  kafka_metrics_reporters =3D kafka_metrics_reporters + "= ;org.apache.hadoop.metrics2.sink.kafka.KafkaTimelineMetricsReporter"


​

From: Alejandro Fernandez &= lt;afernandez@hortonworks.com>
Sent: Wednesday, September 23, 2015 6:32 PM
To: user@ambari.apache.org; Sriharsha Chintalapani; coooldrw@gmail.c= om
Subject: Re: Couldn't change value of kafka.metrics.reporters
 


From: Alejandro Fernandez <afernandez@hortonworks.com>=
Date: Wednesday, September 23, 2015= at 8:32 AM
To: "user@ambari.apache.org" <user@ambari.apache.org>, Sriharsha Chintalapani= <schintalapani@hortonw= orks.com>
Subject: Re: Couldn't change value = of kafka.metrics.reporters

cc Sriharsha

From: Darwin Wirawan <coooldrw@gmail.com>
Reply-To: "user@ambari.apache.org" <user@ambari.apache.org>
Date: Wednesday, September 23, 2015= at 1:20 AM
To: "user@ambari.apache.org" <user@ambari.apache.org>
Subject: Couldn't change value of k= afka.metrics.reporters

Hello Ambari Team,

I'm using ambari 2.0,  and now I'm trying to configure Kafka so s= he could send metric via kafka-graphite. I'm new to monitoring or metrics t= hing, I tried to figure out what is metrics.reporter?

And also, why I can't change kafka.metrics.reporters in my kafka confi= guration? I changed it via ambari but when I check kafka.properties, the va= lue still in default (org.apache.hadoop.metrics2.sink.kafka.KafkaTimelineMe= tricsReporter).

Is there any way so I can change my kafka.metrics.reporters?

Another question, I found my kafka has some metrics, I guess my Ambari= Metrics is running OK. Can I pass that metrics to graphite? Or somehow cha= nge the destination to my graphite server?

Thanks,
Darwin
--_000_144302549980610151hortonworkscom_--