Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 52D9817972 for ; Tue, 21 Apr 2015 17:51:07 +0000 (UTC) Received: (qmail 68718 invoked by uid 500); 21 Apr 2015 17:51:01 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 68615 invoked by uid 500); 21 Apr 2015 17:51:01 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 68604 invoked by uid 99); 21 Apr 2015 17:51:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Apr 2015 17:51:01 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: message received from 54.76.25.247 which is an MX secondary for user@hadoop.apache.org) Received: from [54.76.25.247] (HELO mx1-eu-west.apache.org) (54.76.25.247) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Apr 2015 17:50:35 +0000 Received: from nk11p18im-asmtp002.me.com (nk11p18im-asmtp002.me.com [17.158.120.161]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id AA5D124B3D for ; Tue, 21 Apr 2015 17:50:33 +0000 (UTC) Received: from [192.168.0.7] (ua-83-227-12-104.cust.bredbandsbolaget.se [83.227.12.104]) by nk11p18im-asmtp002.me.com (Oracle Communications Messaging Server 7.0.5.35.0 64bit (built Dec 4 2014)) with ESMTPSA id <0NN6008IU46UR110@nk11p18im-asmtp002.me.com> for user@hadoop.apache.org; Tue, 21 Apr 2015 17:49:44 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.13.68,1.0.33,0.0.0000 definitions=2015-04-21_06:2015-04-21,2015-04-21,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 suspectscore=1 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1412110000 definitions=main-1504210187 From: Akmal Abbasov Content-type: multipart/alternative; boundary="Apple-Mail=_0C440809-A81F-4724-959B-246E92C170B1" Message-id: <9A21717C-FA33-4C3F-B078-B390F52F92E1@icloud.com> MIME-version: 1.0 (Mac OS X Mail 8.2 \(2098\)) Subject: Re: Filtering hadoop metrics Date: Tue, 21 Apr 2015 19:49:40 +0200 References: <5FC2E262-3926-4F64-84B4-1E0478EE6816@icloud.com> To: user@hadoop.apache.org In-reply-to: <5FC2E262-3926-4F64-84B4-1E0478EE6816@icloud.com> X-Mailer: Apple Mail (2.2098) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_0C440809-A81F-4724-959B-246E92C170B1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi Ted, I=E2=80=99ve tried [Ugi]*Metrics[System]*, and in this case the output contains both of them. Thank you. > On 21 Apr 2015, at 19:39, Akmal Abbasov = wrote: >=20 > Hi Ted, > I am using hadoop-2.5.1 > Thank you. >=20 >> On 21 Apr 2015, at 19:32, Ted Yu > wrote: >>=20 >> What release of hadoop are you using ? >>=20 >> Maybe try regex such as: >> [Ugi]*Metrics[System]* >>=20 >> Cheers >>=20 >> On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov = > wrote: >> Hi, I am now working on hadoop cluster monitoring, and currently = playing with hadoop-metrics2.properties file. I would like to use = filters to exclude the records which I am not going to use. >> In fact I am trying to exclude =E2=80=9CUgiMetrics=E2=80=9D and = =E2=80=9CMetricsSystem=E2=80=9D records, by using the following >> datanode.sink.file.record.filter.exclude=3DUgiMetrics >> datanode.sink.file.record.filter.exclude=3DMetricsSystem >>=20 >> But the problem, is that since I am using the same key for different = values, only the first one is excluded. I=E2=80=99ve tried to use = something like >> 1. datanode.sink.file.record.filter.exclude=3D UgiMetrics, = MetricsSystem >> 2. datanode.sink.file.record.filter.exclude=3D UgiMetrics | = MetricsSystem >> but, in both cases I got the same result, only UgiMetrics are = excluded. >>=20 >> Is there any way to exclude arbitrary number of records? >> Thank you. >>=20 >=20 --Apple-Mail=_0C440809-A81F-4724-959B-246E92C170B1 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Hi Ted,
I=E2=80=99ve tried [Ugi]*Metrics[System]*,
and in this case the output contains both of = them.
Thank = you.

On = 21 Apr 2015, at 19:39, Akmal Abbasov <akmal.abbasov@icloud.com> wrote:

Hi Ted,
I am using hadoop-2.5.1
Thank = you.

On 21 = Apr 2015, at 19:32, Ted Yu <yuzhihong@gmail.com> wrote:

What release of hadoop are you using ?

Maybe try regex such as:
[Ugi]*Metrics[System]*
Cheers

On Tue, = Apr 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com> wrote:
Hi, I am now working = on hadoop cluster monitoring, and currently playing with = hadoop-metrics2.properties file. I would like to use filters to exclude = the records which I am not going to use.
In fact I am trying to exclude =E2=80=9CUgiMetrics=E2=80=9D and = =E2=80=9CMetricsSystem=E2=80=9D records, by using the following
datanode.sink.file.record.filter.exclude=3DUgiMetrics
datanode.sink.file.record.filter.exclude=3DMetricsSystem

But the problem, is that since I am using the same key for different = values, only the first one is excluded. I=E2=80=99ve tried to use = something like
1. datanode.sink.file.record.filter.exclude=3D UgiMetrics, = MetricsSystem
2. datanode.sink.file.record.filter.exclude=3D UgiMetrics | = MetricsSystem
but, in both cases I got the same result, only UgiMetrics are = excluded.

Is there any way to exclude arbitrary number of records?
Thank you.



= --Apple-Mail=_0C440809-A81F-4724-959B-246E92C170B1--