hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-2858) Cache remote map reduce job stack traces for additional logging
Date Fri, 09 Mar 2012 03:40:02 GMT

     [ https://issues.apache.org/jira/browse/HIVE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Phabricator updated HIVE-2858:
------------------------------

    Attachment: HIVE-2858.D2223.1.patch

kevinwilfong requested code review of "HIVE-2858 [jira] Cache remote map reduce job stack
traces for additional logging".
Reviewers: JIRA

  https://issues.apache.org/jira/browse/HIVE-2858

  Modified the JobDebugger and TaskLogProcessor to parse out stack traces from failed task
logs.  These are stored in a mapping from job ID to stack traces in the SessionState.

  Currently we are parsing the task logs for failed jobs for information to display to the
user in the CLI.  In addition, we could parse those logs for stack traces and store e them
in the SessionState.  This way, when we log failed queries, these will give us a decent idea
of why those queries failed.

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D2223

AFFECTED FILES
  conf/hive-default.xml.template
  build-common.xml
  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
  ql/src/test/results/clientnegative/mapreduce_stack_trace_turnoff.q.out
  ql/src/test/results/clientnegative/mapreduce_stack_trace.q.out
  ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifySessionStateStackTracesHook.java
  ql/src/test/queries/clientnegative/mapreduce_stack_trace.q
  ql/src/test/queries/clientnegative/mapreduce_stack_trace_turnoff.q
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/errors/TaskLogProcessor.java
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/4875/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.

                
> Cache remote map reduce job stack traces for additional logging
> ---------------------------------------------------------------
>
>                 Key: HIVE-2858
>                 URL: https://issues.apache.org/jira/browse/HIVE-2858
>             Project: Hive
>          Issue Type: Improvement
>          Components: Logging
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-2858.D2223.1.patch
>
>
> Currently we are parsing the task logs for failed jobs for information to display to
the user in the CLI.  In addition, we could parse those logs for stack traces and store e
them in the SessionState.  This way, when we log failed queries, these will give us a decent
idea of why those queries failed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message