tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jihoon Son (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (TAJO-333) Add metric system to Tajo
Date Thu, 12 Dec 2013 07:34:09 GMT

    [ https://issues.apache.org/jira/browse/TAJO-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13846120#comment-13846120
] 

Jihoon Son edited comment on TAJO-333 at 12/12/13 7:33 AM:
-----------------------------------------------------------

The Ganglia reporter looks really great!
But, I have a question for the console reporter.
I configured logj4.properties as in this patch.
{noformat}
log4j.rootLogger=info,stdout,EventCounter
log4j.threshhold=ALL
log4j.appender.stdout=org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout=org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=%d{ISO8601} %-5p %c{2} (%F:%M(%L)) - %m%n
log4j.logger.org.apache.hadoop=WARN
log4j.logger.org.apache.hadoop.conf=ERROR
log4j.appender.EventCounter=org.apache.tajo.util.metrics.TajoLogEventCounter
{noformat}

I run a query of "select count( * ) from lineitem" for a 1GB table on a single machine cluster.
The console reports seems to be written to the query master log, but I can't find it anywhere.

Would you tell me how I can see the console report?


was (Author: jihoonson):
The Ganglia reporter looks really great!
But, I have a question for the console reporter.
I configured logj4.properties as in this patch.
{noformat}
log4j.rootLogger=info,stdout,EventCounter
log4j.threshhold=ALL
log4j.appender.stdout=org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout=org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=%d{ISO8601} %-5p %c{2} (%F:%M(%L)) - %m%n
log4j.logger.org.apache.hadoop=WARN
log4j.logger.org.apache.hadoop.conf=ERROR
log4j.appender.EventCounter=org.apache.tajo.util.metrics.TajoLogEventCounter
{noformat}

I run a query of "select count(*) from lineitem" for a 1GB table on a single machine cluster.
The console reports seems to be written to the query master log, but I can't find it anywhere.

Would you tell me how I can see the console report?

> Add metric system to Tajo
> -------------------------
>
>                 Key: TAJO-333
>                 URL: https://issues.apache.org/jira/browse/TAJO-333
>             Project: Tajo
>          Issue Type: New Feature
>            Reporter: Hyunsik Choi
>            Assignee: hyoungjunkim
>              Labels: metrics
>             Fix For: 0.8-incubating
>
>         Attachments: TAJO-333.patch, TAJO-333_2.patch, tajo-ganglia-01.png, tajo-ganglia-02.png
>
>
> Currently, there is no way to measure and observe Tajo's internal operations. As a Hadoop
job, Tajo also should measure and record a lot of operational works.
> I would like to propose the use of Metrics (http://metrics.codahale.com/). It is well
known as a stable and efficient metric library.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message