Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2E8DD17872 for ; Tue, 21 Apr 2015 17:33:32 +0000 (UTC) Received: (qmail 83007 invoked by uid 500); 21 Apr 2015 17:33:26 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 82903 invoked by uid 500); 21 Apr 2015 17:33:26 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 82892 invoked by uid 99); 21 Apr 2015 17:33:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Apr 2015 17:33:26 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: message received from 54.76.25.247 which is an MX secondary for user@hadoop.apache.org) Received: from [54.76.25.247] (HELO mx1-eu-west.apache.org) (54.76.25.247) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Apr 2015 17:33:00 +0000 Received: from mail-ob0-f172.google.com (mail-ob0-f172.google.com [209.85.214.172]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 1AE7F25F4B for ; Tue, 21 Apr 2015 17:32:59 +0000 (UTC) Received: by oblw8 with SMTP id w8so151434285obl.0 for ; Tue, 21 Apr 2015 10:32:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=AcelysgR/dSrCuEga9kAYcs+VTut7TpokW79U8TI5qw=; b=JZGFnpDdsK90Cd8XFCk03zVWdp/VqJdrH5aE85HohtWBoAInY/DKwSBxMd4W9GzmoO Vw+R7MeWfmTy5i/KJpRk16ptrVrgBK77gYFSPd7VDdOAhiLi5THgXVnWwOGKVwD2KC/G MYfc7lxh0nePSb/HMfkKfIWRfqwO/duvZ+8MQTcNjDsTZJObXFHdLtI+JwDwd0KKGq7t OCc/3cykeUcZq7CBejxB9ZOsGo3WUEdYYBCeah8hrYWsnBUS+WCbpZeqH5Z3tHPLvZYr vSfT4eKiXFvlXwn8a4F9G4DzFxIkA2N9ceA0qVnAQIt1MvHCAJXoVqTVJvuQWU4zQ8D+ jTdA== MIME-Version: 1.0 X-Received: by 10.202.168.204 with SMTP id r195mr19058108oie.32.1429637578062; Tue, 21 Apr 2015 10:32:58 -0700 (PDT) Received: by 10.202.177.2 with HTTP; Tue, 21 Apr 2015 10:32:57 -0700 (PDT) In-Reply-To: References: Date: Tue, 21 Apr 2015 10:32:57 -0700 Message-ID: Subject: Re: Filtering hadoop metrics From: Ted Yu To: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a113cd876ff803f05143f6ffc X-Virus-Checked: Checked by ClamAV on apache.org --001a113cd876ff803f05143f6ffc Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable What release of hadoop are you using ? Maybe try regex such as: [Ugi]*Metrics[System]* Cheers On Tue, Apr 21, 2015 at 9:43 AM, Akmal Abbasov wrote: > Hi, I am now working on hadoop cluster monitoring, and currently playing > with hadoop-metrics2.properties file. I would like to use filters to > exclude the records which I am not going to use. > In fact I am trying to exclude =E2=80=9CUgiMetrics=E2=80=9D and =E2=80=9C= MetricsSystem=E2=80=9D records, > by using the following > datanode.sink.file.record.filter.exclude=3DUgiMetrics > datanode.sink.file.record.filter.exclude=3DMetricsSystem > > But the problem, is that since I am using the same key for different > values, only the first one is excluded. I=E2=80=99ve tried to use somethi= ng like > 1. datanode.sink.file.record.filter.exclude=3D UgiMetrics, MetricsSystem > 2. datanode.sink.file.record.filter.exclude=3D UgiMetrics | MetricsSystem > but, in both cases I got the same result, only UgiMetrics are excluded. > > Is there any way to exclude arbitrary number of records? > Thank you. --001a113cd876ff803f05143f6ffc Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
What release of hadoop are you using ?

= Maybe try regex such as:
[Ugi]*Metrics[System]*

Cheers

On Tue, Ap= r 21, 2015 at 9:43 AM, Akmal Abbasov <akmal.abbasov@icloud.com&= gt; wrote:
Hi, I am now working on= hadoop cluster monitoring, and currently playing with hadoop-metrics2.prop= erties file. I would like to use filters to exclude the records which I am = not going to use.
In fact I am trying to exclude =E2=80=9CUgiMetrics=E2=80=9D and =E2=80=9CMe= tricsSystem=E2=80=9D records, by using the following
datanode.sink.file.record.filter.exclude=3DUgiMetrics
datanode.sink.file.record.filter.exclude=3DMetricsSystem

But the problem, is that since I am using the same key for different values= , only the first one is excluded. I=E2=80=99ve tried to use something like<= br> 1. datanode.sink.file.record.filter.exclude=3D UgiMetrics, MetricsSystem 2. datanode.sink.file.record.filter.exclude=3D UgiMetrics | MetricsSystem but, in both cases I got the same result, only UgiMetrics are excluded.

Is there any way to exclude arbitrary number of records?
Thank you.

--001a113cd876ff803f05143f6ffc--