hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2866) Cache local map reduce job errors for additional logging
Date Sat, 31 Mar 2012 21:38:26 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243298#comment-13243298
] 

Hudson commented on HIVE-2866:
------------------------------

Integrated in Hive-trunk-h0.21 #1343 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1343/])
    HIVE-2866 Cache local map reduce job errors for additional logging
(Kevin Wilfong via namit) (Revision 1307814)

     Result = FAILURE
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1307814
Files : 
* /hive/trunk/common/src/java/org/apache/hadoop/hive/common/io/CachingPrintStream.java
* /hive/trunk/data/scripts/cat_error.py
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifySessionStateLocalErrorsHook.java
* /hive/trunk/ql/src/test/queries/clientnegative/local_mapred_error_cache.q
* /hive/trunk/ql/src/test/results/clientnegative/local_mapred_error_cache.q.out

                
> Cache local map reduce job errors for additional logging
> --------------------------------------------------------
>
>                 Key: HIVE-2866
>                 URL: https://issues.apache.org/jira/browse/HIVE-2866
>             Project: Hive
>          Issue Type: Improvement
>          Components: Logging
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-2866.D2277.1.patch
>
>
> Using the CachingPrintStream we are storing errors that occur locally in Hive, but because
local map reduce jobs are run in a separate JVM we are not storing that occur for these. We
can use this same construct to store errors written to the subprocesses error stream.  This
way, when we log failed queries, these will give us a decent idea of why those queries failed.
> See related issues:
> https://issues.apache.org/jira/browse/HIVE-2832
> https://issues.apache.org/jira/browse/HIVE-2858

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message