hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6004) Adding more logging to help debugging MR job
Date Tue, 15 May 2012 22:25:10 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276287#comment-13276287
] 

jiraposter@reviews.apache.org commented on HBASE-6004:
------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5131/
-----------------------------------------------------------

Review request for hbase.


Summary
-------

Added some logging for MR debugging in case scanner times out.  The logging is disabled by
default.
It will be helpful to know how much time spent in the scanner and, how much in the mapper
task.
In case scanner issue, it is helpful to know the region server id, last successful rows and
so on.


This addresses bug HBASE-6004.
    https://issues.apache.org/jira/browse/HBASE-6004


Diffs
-----

  src/main/java/org/apache/hadoop/hbase/client/ScannerCallable.java 46b1c56 
  src/main/java/org/apache/hadoop/hbase/mapred/TableRecordReaderImpl.java 42569fb 
  src/main/java/org/apache/hadoop/hbase/mapreduce/TableRecordReaderImpl.java 1c8a393 

Diff: https://reviews.apache.org/r/5131/diff


Testing
-------


Thanks,

Jimmy


                
> Adding more logging to help debugging MR job
> --------------------------------------------
>
>                 Key: HBASE-6004
>                 URL: https://issues.apache.org/jira/browse/HBASE-6004
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.94.0, 0.96.0
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Minor
>             Fix For: 0.94.0, 0.96.0
>
>         Attachments: hbase-6004.patch
>
>
> MR job sometime fails because scanner expired. In this case, it will be helpful to know
the last successful row, the ip of the region sever, and so on.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message