hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Antony (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-176) structured log for obtaining query stats/info
Date Tue, 16 Dec 2008 02:39:44 GMT

    [ https://issues.apache.org/jira/browse/HIVE-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12656855#action_12656855
] 

Suresh Antony commented on HIVE-176:
------------------------------------

Some thoughts about logging:
  -  Thinking of following the same format as  hadoop logging for the jobs
   - each  query will have separate file.  location of the file will be printed to stdout
while running the query.
   - Format of the entries in file will be of the following.
   <ENTRY TYPE> id=value key1=value1 key2=value2 .....
  - Different entry types can be:
     -QueryStart
     -QueryEnd
     -QueryStepStart
    -QueryStepEnd 
    -QueryStepProgress





> structured log for obtaining query stats/info
> ---------------------------------------------
>
>                 Key: HIVE-176
>                 URL: https://issues.apache.org/jira/browse/HIVE-176
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Logging
>            Reporter: Joydeep Sen Sarma
>
> Josh <josh@besquared.net> wrote:
> When launching off hive queries using hive -e is there a way to get the job id so that
I can just queue them up and go check their statuses later? What's the general pattern for
queueing and monitoring without using the libraries directly?
> I'm gonna throw my vote in for a structured log format. Users could tail it and use whatever
queuing or monitoring they wish. It's also probably just a 30 minute project for someone already
familiar with the code. I suggest ^A seperated key=value pairs per log line.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message