Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8D0C49C48 for ; Tue, 17 Apr 2012 20:08:25 +0000 (UTC) Received: (qmail 99947 invoked by uid 500); 17 Apr 2012 20:08:25 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 99916 invoked by uid 500); 17 Apr 2012 20:08:25 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 99907 invoked by uid 99); 17 Apr 2012 20:08:25 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Apr 2012 20:08:25 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [198.49.146.77] (HELO smtpksrv1.mitre.org) (198.49.146.77) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Apr 2012 20:08:15 +0000 Received: from smtpksrv1.mitre.org (localhost.localdomain [127.0.0.1]) by localhost (Postfix) with SMTP id 492BB21B10B9 for ; Tue, 17 Apr 2012 16:07:54 -0400 (EDT) Received: from IMCCAS04.MITRE.ORG (imccas04.mitre.org [129.83.29.81]) by smtpksrv1.mitre.org (Postfix) with ESMTP id 3E8DF21B11BE for ; Tue, 17 Apr 2012 16:07:54 -0400 (EDT) Received: from IMCMBX02.MITRE.ORG ([169.254.2.252]) by IMCCAS04.MITRE.ORG ([129.83.29.81]) with mapi id 14.02.0283.003; Tue, 17 Apr 2012 16:07:53 -0400 From: "Kini, Ameet M." To: "user@accumulo.apache.org" Subject: RE: monitoring Thread-Topic: monitoring Thread-Index: Ac0ZsNFIL5JT03lPQ+OGWP5MqfH8vgALUDEAAAAJPQAAgJ1J4AAL6f4AAABfE3A= Date: Tue, 17 Apr 2012 20:07:53 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [128.29.3.14] Content-Type: multipart/alternative; boundary="_000_D4A4E7DA705CD141A76877C2206A60A20AD53511IMCMBX02MITREOR_" MIME-Version: 1.0 --_000_D4A4E7DA705CD141A76877C2206A60A20AD53511IMCMBX02MITREOR_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Eric, Got sidetracked for a day there. So I was able to start a tsd but the mkmet= ric command gets a zookeeper NoNodeException. I know that my zookeeper is a= ccessible because tsd can talk to it fine. Any clues? Thanks, Ameet [hadoop build]$ ./tsdb mkmetric proc.loadavg.1min --instance=3Dfoo --zkquor= um=3Dfoo --auser=3Dfoo --apass=3Dfoo 2012-04-17 16:55:56,222 ERROR [main] UniqueId: WTF? Unexpected exception t= ype when assigning an ID, ICV on row=3D[0] column=3D'id:metrics' org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =3D N= oNode for /tsdb/maxId at org.apache.zookeeper.KeeperException.create(KeeperException.java= :102) ~[zookeeper-3.3.4.jar:3.3.3-1203054] at org.apache.zookeeper.KeeperException.create(KeeperException.java= :42) ~[zookeeper-3.3.4.jar:3.3.3-1203054] at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927) ~[zoo= keeper-3.3.4.jar:3.3.3-1203054] at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:275) ~[tsd= b-1.1.0.jar:] at net.opentsdb.tools.UidManager.assign(UidManager.java:286) [tsdb-= 1.1.0.jar:] at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175) [t= sdb-1.1.0.jar:] at net.opentsdb.tools.UidManager.main(UidManager.java:141) [tsdb-1.= 1.0.jar:] 2012-04-17 16:55:56,236 ERROR [main] UniqueId: WTF? Unexpected exception t= ype when assigning an ID, ICV on row=3D[0] column=3D'id:metrics' org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =3D N= oNode for /tsdb/maxId at org.apache.zookeeper.KeeperException.create(KeeperException.java= :102) ~[zookeeper-3.3.4.jar:3.3.3-1203054] at org.apache.zookeeper.KeeperException.create(KeeperException.java= :42) ~[zookeeper-3.3.4.jar:3.3.3-1203054] at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927) ~[zoo= keeper-3.3.4.jar:3.3.3-1203054] at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:275) ~[tsd= b-1.1.0.jar:] at net.opentsdb.tools.UidManager.assign(UidManager.java:286) [tsdb-= 1.1.0.jar:] at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175) [t= sdb-1.1.0.jar:] at net.opentsdb.tools.UidManager.main(UidManager.java:141) [tsdb-1.= 1.0.jar:] 2012-04-17 16:55:56,247 ERROR [main] UniqueId: WTF? Unexpected exception t= ype when assigning an ID, ICV on row=3D[0] column=3D'id:metrics' org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =3D N= oNode for /tsdb/maxId at org.apache.zookeeper.KeeperException.create(KeeperException.java= :102) ~[zookeeper-3.3.4.jar:3.3.3-1203054] at org.apache.zookeeper.KeeperException.create(KeeperException.java= :42) ~[zookeeper-3.3.4.jar:3.3.3-1203054] at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927) ~[zoo= keeper-3.3.4.jar:3.3.3-1203054] at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:275) ~[tsd= b-1.1.0.jar:] at net.opentsdb.tools.UidManager.assign(UidManager.java:286) [tsdb-= 1.1.0.jar:] at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175) [t= sdb-1.1.0.jar:] at net.opentsdb.tools.UidManager.main(UidManager.java:141) [tsdb-1.= 1.0.jar:] Exception in thread "main" java.lang.IllegalStateException: Should never ha= ppen! at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:362) at net.opentsdb.tools.UidManager.assign(UidManager.java:286) at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175) at net.opentsdb.tools.UidManager.main(UidManager.java:141) -Ameet Kini From: Eric Newton [mailto:eric.newton@gmail.com] Sent: Monday, April 16, 2012 12:35 PM To: user@accumulo.apache.org Subject: Re: monitoring Yes, you have to create the tables: shell> createtable tsdb shell> createtable tsdb_uid I didn't update their script because the creation of the tables is trivial = in accumulo. You have to specify your instance when you run tsd: $ ./build/tsdb tsd --port=3D4242 --staticroot=3Dbuild/staticroot --cachedir= =3D"$tsdtmp" --instance myinstance -Eric On Mon, Apr 16, 2012 at 11:53 AM, Kini, Ameet M. > wrote: Adam/Eric, thanks for your helpful responses. Eric, I'm looking at your openTSDB port. With it and the tcollector changes= , if I understand correctly, I can use an existing Accumulo backend to stor= e the metrics ? I wasn't sure because src/create_table.sh still refers to H= Base. Also, if there are any special setup instructions instead or in addit= ion to http://opentsdb.net/getting-started.html, would be good to know. -Ameet Kini From: Eric Newton [mailto:eric.newton@gmail.com] Sent: Friday, April 13, 2012 5:31 PM To: user@accumulo.apache.org Subject: Re: monitoring Oops... premature send. Also check out: http://github.com/ericnewton/tcollector -Eric On Fri, Apr 13, 2012 at 5:29 PM, Eric Newton > wrote: We have used hobbit, and ganglia... which explains why the master monitorin= g page shows so much information. I am going to continue to work on opentsdb support. Maybe this weekend I'l= l get around to teasing apart the hbase/accumulo back-ends and see if they = will accept the patches. Check out: http://github.com/ericnewton/opentsdb On Fri, Apr 13, 2012 at 4:05 PM, Kini, Ameet M. > wrote: What are folks using to monitor Accumulo - the master status page, Ganglia,= openTSDB, anything else? I was looking into Ganglia but wasn't sure how/if Accumulo works with it. W= ould the Accumulo daemons send metrics directly to the gmond, would the me= trics be dumped to a file and then read back, some other indirect way? Any = online pointers would also be useful. Thanks, -Ameet Kini --_000_D4A4E7DA705CD141A76877C2206A60A20AD53511IMCMBX02MITREOR_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

 <= /p>

 <= /p>

Eric,

 <= /p>

Got sidetracked for a day= there. So I was able to start a tsd but the mkmetric command gets a zookee= per NoNodeException. I know that my zookeeper is accessible because tsd can talk to it fine. Any clues?  

 <= /p>

Thanks,=

Ameet

 <= /p>

[hadoop build]$ ./tsdb mk= metric proc.loadavg.1min --instance=3Dfoo --zkquorum=3Dfoo --auser=3Dfoo --= apass=3Dfoo

2012-04-17 16:55:56,222 E= RROR [main] UniqueId: WTF?  Unexpected exception type when assigning a= n ID, ICV on row=3D[0] column=3D'id:metrics'

org.apache.zookeeper.Keep= erException$NoNodeException: KeeperErrorCode =3D NoNode for /tsdb/maxId

    &= nbsp;   at org.apache.zookeeper.KeeperException.create(KeeperExce= ption.java:102) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at org.apache.zookeeper.KeeperException.create(KeeperExce= ption.java:42) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:= 927) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:= 275) ~[tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.assign(UidManager.java:2= 86) [tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.runCommand(UidManager.ja= va:175) [tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.main(UidManager.java:141= ) [tsdb-1.1.0.jar:]

2012-04-17 16:55:56,236 E= RROR [main] UniqueId: WTF?  Unexpected exception type when assigning a= n ID, ICV on row=3D[0] column=3D'id:metrics'

org.apache.zookeeper.Keep= erException$NoNodeException: KeeperErrorCode =3D NoNode for /tsdb/maxId

    &= nbsp;   at org.apache.zookeeper.KeeperException.create(KeeperExce= ption.java:102) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at org.apache.zookeeper.KeeperException.create(KeeperExce= ption.java:42) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:= 927) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:= 275) ~[tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.assign(UidManager.java:2= 86) [tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.runCommand(UidManager.ja= va:175) [tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.main(UidManager.java:141= ) [tsdb-1.1.0.jar:]

2012-04-17 16:55:56,247 E= RROR [main] UniqueId: WTF?  Unexpected exception type when assigning a= n ID, ICV on row=3D[0] column=3D'id:metrics'

org.apache.zookeeper.Keep= erException$NoNodeException: KeeperErrorCode =3D NoNode for /tsdb/maxId

    &= nbsp;   at org.apache.zookeeper.KeeperException.create(KeeperExce= ption.java:102) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at org.apache.zookeeper.KeeperException.create(KeeperExce= ption.java:42) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:= 927) ~[zookeeper-3.3.4.jar:3.3.3-1203054]

    &= nbsp;   at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:= 275) ~[tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.assign(UidManager.java:2= 86) [tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.runCommand(UidManager.ja= va:175) [tsdb-1.1.0.jar:]

    &= nbsp;   at net.opentsdb.tools.UidManager.main(UidManager.java:141= ) [tsdb-1.1.0.jar:]

Exception in thread "= ;main" java.lang.IllegalStateException: Should never happen!

    &= nbsp;   at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:= 362)

    &= nbsp;   at net.opentsdb.tools.UidManager.assign(UidManager.java:2= 86)

    &= nbsp;   at net.opentsdb.tools.UidManager.runCommand(UidManager.ja= va:175)

    &= nbsp;   at net.opentsdb.tools.UidManager.main(UidManager.java:141= )

 <= /p>

-Ameet Kini

 <= /p>

From: Eric Newton [mailto:eric.newton@gmail.com]
Sent: Monday, April 16, 2012 12:35 PM
To: user@accumulo.apache.org
Subject: Re: monitoring

 

Yes, you have to create t= he tables:

 

shell> createtable tsd= b

shell> createtable tsd= b_uid

 

I didn't update their scr= ipt because the creation of the tables is trivial in accumulo. You have to = specify your instance when you run tsd:

 

$ ./build/ts= db tsd --port=3D4242 --staticroot=3Dbuild/staticroot --cachedir=3D"$ts= dtmp" --instance myinstance

 

-Eric<= /span>

On Mon, Apr 16, 2012 at 1= 1:53 AM, Kini, Ameet M. <akini@mitre.= org> wrote:

 

 

Adam/Eric, thanks for your helpful responses.

 

Eric, I’m looking at your openTSDB port. W= ith it and the tcollector changes, if I understand correctly, I can use an = existing Accumulo backend to store the metrics ? I wasn’t sure because src/create_table.sh still refers to HBase. Also, if there are any = special setup instructions instead or in addition to http://opentsdb.net/getting-started.html, would be good to know.

 

-Ameet Kini

 

From: Eric Newton [mailto:eric.newton@gmail.com]
Sent: Friday, April 13, 2012 5:31 PM
To: us= er@accumulo.apache.org
Subject: Re: monitoring

 

Oops... premature send.  Also check out:

 

 

-Eric

On Fri, Apr 13, 2012 at 5:29 PM, Eric Newton <eric.newton@gmail.com> wrote:<= /o:p>

We have used hobbit, and ganglia... which explains why the master monitorin= g page shows so much information.

 

I am going to continue to work on opentsdb support.  Maybe this weeken= d I'll get around to teasing apart the hbase/accumulo back-ends and see if = they will accept the patches.

 

Check out:

 

 

 

On Fri, Apr 13, 2012 at 4:05 PM, Kini, Ameet M. <akini@mitre.org> wrote:

 

What are folks using to monitor Accumulo R= 11; the master status page, Ganglia, openTSDB, anything else?

 

I was looking into Ganglia but wasn’t s= ure how/if Accumulo works with it. Would the Accumulo daemons send metrics = directly to the gmond,  would the metrics be dumped to a file and then= read back, some other indirect way? Any online pointers would also be useful.

 

Thanks,

-Ameet Kini

 

 

 

 

--_000_D4A4E7DA705CD141A76877C2206A60A20AD53511IMCMBX02MITREOR_--