ambari-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aravindan Vijayan <avija...@hortonworks.com>
Subject Re: Posting Metrics to Ambari - Metrics Collector
Date Wed, 16 Dec 2015 00:28:31 GMT
Hi Matt,

Please check if there are any exceptions in the metrics collector log, usually found at /var/log/ambari-metrics-collector.

Also, AMS APP_IDs are case dependent. Hence, please double check the case and spelling of
the APP_ID by doing a 'SELECT distinct APP_ID' on the METRIC_RECORD and METRIC_AGGREGATE tables.

--
Thanks and Regards,
Aravindan Vijayan

From: matt Lieber
Reply-To: "user@ambari.apache.org<mailto:user@ambari.apache.org>"
Date: Monday, December 14, 2015 at 10:15 AM
To: "user@ambari.apache.org<mailto:user@ambari.apache.org>"
Subject: Re: Posting Metrics to Ambari - Metrics Collector


Answers to your questions:


0: jdbc:phoenix:localhost:61181:/hbase> SELECT METRIC_NAME, SERVER_TIME, APP_ID

. . . . . . . . . . . . . . . . . . . >   FROM METRIC_RECORD WHERE APP_ID = 'amssmoketestfake'

. . . . . . . . . . . . . . . . . . . >   ;

+------------------------------------------+------------------------------------------+------------------------------------------+

|               METRIC_NAME                |               SERVER_TIME                |  
               APP_ID                  |

+------------------------------------------+------------------------------------------+------------------------------------------+

+------------------------------------------+------------------------------------------+------------------------------------------+

No rows selected (4.394 seconds)


and, GET call:

http://127.0.0.1:6188/ws/v1/timeline/metrics?metricNames=AMBARI_METRICS.SmokeTest.FakeMetric&appId=amssmoketestfake&hostname=127.0.0.1&precision=seconds&startTime=1432075898000&endTime=1432075898003

{"metrics":[]}


odd, isn't it ?


thanks,
Matt

On Fri, Dec 11, 2015 at 4:53 PM, Aravindan Vijayan <avijayan@hortonworks.com<mailto:avijayan@hortonworks.com>>
wrote:
Hi Matt,

What is the phoenix result to the following query?
select * from metric_record where app_id = ‘amssmoketestfake’ LIMIT 5;

And what do you get back when you make the GET call to AMS for getting the metrics you sent?

Thanks
-
Thanks and Regards,
Aravindan Vijayan

From: matt Lieber
Reply-To: "user@ambari.apache.org<mailto:user@ambari.apache.org>"
Date: Thursday, December 10, 2015 at 10:53 AM
To: "user@ambari.apache.org<mailto:user@ambari.apache.org>"
Subject: Re: Posting Metrics to Ambari - Metrics Collector

Ok never mind, in addition had to specify i was posting JSON data. Now i got a 200 OK response.
Getting this in the log as confirmation:
2015-12-10 18:41:37,476 DEBUG org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TimelineWebServices:
Storing metrics: {
"metrics" : [ {
"timestamp" : 1432075898000,
"metricname" : "AMBARI_METRICS.SmokeTest.FakeMetric",
"appid" : "amssmoketestfake",
"hostname" : "127.0.0.1",
"starttime" : 1432075898000,
"metrics" : {
"1432075898000" : 0.963781711428,
"1432075899000" : 1.432075898E12
}
} ]
}
The only thing is, i am not able to read it back. I tried to query this via Phoenix, but not
getting anything :

0: jdbc:phoenix:localhost:61181:/hbase> SELECT METRIC_NAME, SERVER_TIME, APP_ID

. . . . . . . . . . . . . . . . . . . >   FROM METRIC_RECORD WHERE APP_ID = 'amssmoketestfake'

. . . . . . . . . . . . . . . . . . . >   ORDER BY SERVER_TIME LIMIT 10;

+------------------------------------------+------------------------------------------+------------------------------------------+

|               METRIC_NAME                |               SERVER_TIME                |  
               APP_ID                  |

+------------------------------------------+------------------------------------------+------------------------------------------+

+------------------------------------------+------------------------------------------+------------------------------------------+

No rows selected (4.394 seconds)

0: jdbc:phoenix:localhost:61181:/hbase>


any ideas ?

Thanks -


On Thu, Dec 10, 2015 at 9:32 AM, matt Lieber <matt.lieber@gmail.com<mailto:matt.lieber@gmail.com>>
wrote:
thanks for your answer -
However i get an internal server error with that :

$ wget --post-data="{

  "metrics": [

    {

      "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",

      "appid": "amssmoketestfake",

      "hostname": "127.0.0.1",

      "timestamp": 1432075898000,

      "starttime": 1432075898000,

      "metrics": {

        "1432075898000": 0.963781711428,

        "1432075899000": 1432075898000

      }

    }

  ]

}" http://127.0.0.1:6188/ws/v1/timeline/metrics/​

--2015-12-10 09:24:52--  http://127.0.0.1:6188/ws/v1/timeline/metrics/%E2%80%8B

Connecting to 127.0.0.1:6188... connected.

HTTP request sent, awaiting response... 500 Internal Server Error

2015-12-10 09:24:52 ERROR 500: Internal Server Error.



2015-12-10 17:24:52,074 DEBUG org.mortbay.log: call filter guice

2015-12-10 17:24:52,075 WARN org.apache.hadoop.yarn.webapp.GenericExceptionHandler: INTERNAL_SERVER_ERROR

javax.ws.rs.WebApplicationException

at com.sun.jersey.server.impl.uri.rules.TerminatingRule.accept(TerminatingRule.java:66)

at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)

at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)

at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)

at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)

at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)

at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:895)

at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:843)

at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:804)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)

at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)

at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)

at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:109)

at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)

at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1243)

at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)

at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)

at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)

at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)

at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)

at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)

at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)

at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)

at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)

at org.mortbay.jetty.Server.handle(Server.java:322)

at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)

at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)

at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)

at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)

at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)

at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)

at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

2015-12-10 17:24:52,078 DEBUG org.mortbay.log: RESPONSE /ws/v1/timeline/metrics/​  500

On Thu, Dec 10, 2015 at 9:14 AM, Dmitry Sen <dsen@hortonworks.com<mailto:dsen@hortonworks.com>>
wrote:


POST/GET metrics to http://127.0.0.1:6188/ws/v1/timeline/metrics/​


________________________________
From: matt Lieber <matt@bigdatatidbits.cc<mailto:matt@bigdatatidbits.cc>>
Sent: Thursday, December 10, 2015 7:08 PM
To: user@ambari.apache.org<mailto:user@ambari.apache.org>
Subject: Fwd: Posting Metrics to Ambari - Metrics Collector



hi,

I am trying to post metrics to Ambari. I started the Metric collector in Ambari on their sandbox.
Then i followed instructions on https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
and posted:


$ wget --post-data="{

  "metrics": [

    {

      "metricname": "AMBARI_METRICS.SmokeTest.FakeMetric",

      "appid": "amssmoketestfake",

      "hostname": "127.0.0.1",

      "timestamp": 1432075898000,

      "starttime": 1432075898000,

      "metrics": {

        "1432075898000": 0.963781711428,

        "1432075899000": 1432075898000

      }

    }

  ]

}" http://127.0.0.1:6188


--2015-12-10 08:48:42--  (try: 6)  http://127.0.0.1:6188/

Connecting to 127.0.0.1:6188... connected.

HTTP request sent, awaiting response... 302 Found

Location: http://127.0.0.1:6188/applicationhistory [following]

--2015-12-10 08:48:44--  http://127.0.0.1:6188/applicationhistory

Reusing existing connection to 127.0.0.1:6188<http://127.0.0.1:6188>.

HTTP request sent, awaiting response... 200 OK

Length: 5218 (5.1K) [text/html]

Saving to: `index.html.1'


100%[====================================================================================================================================================>]
5,218       --.-K/s   in 0s


2015-12-10 08:48:45 (237 MB/s) - `index.html.1' saved [5218/5218]


Then i looked at the log, started in debug mode, but cant find a trace of the metric ..?

# cat /var/log/ambari-metrics-collector/ambari-metrics-collector.log | grep SmokeTest

[root@sandbox ~]#

I also looked via a query on Phoenix, but to no availability.

anyone knows what's going on ?


cheers,
Matt




Mime
View raw message