hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11994) PutCombiner floods the M/R log with repeated log messages.
Date Tue, 16 Sep 2014 20:48:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136177#comment-14136177
] 

Andrew Purtell commented on HBASE-11994:
----------------------------------------

Thanks for the patch [~adityakishore]. Our apologies for letting that in. This change appears
to have been introduced by HBASE-8874. If possible to also wrap the log message in an if (LOG.isDebugEnabled())
conditional this is good for commit.


> PutCombiner floods the M/R log with repeated log messages.
> ----------------------------------------------------------
>
>                 Key: HBASE-11994
>                 URL: https://issues.apache.org/jira/browse/HBASE-11994
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.98.6
>            Reporter: Aditya Kishore
>            Assignee: Aditya Kishore
>         Attachments: HBASE-11994-PutCombiner-floods-the-M-R-log-with-repe.patch
>
>
> {{o.a.h.h.mapreduce.PutCombiner}} logs an info message for each row that it receives
in its reduce() function, flooding the M/R tasks log.
> {noformat}
> ...............
> 2014-09-12 12:38:02,907 INFO [MapRSpillThread] org.apache.hadoop.hbase.mapreduce.PutCombiner:
Combined 1 Put(s) into 1.
> 2014-09-12 12:38:02,908 INFO [MapRSpillThread] org.apache.hadoop.hbase.mapreduce.PutCombiner:
Combined 1 Put(s) into 1.
> ...............{repeated 100s of thousand times.}
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message