hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerry He (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14557) MapReduce WALPlayer issue with NoTagsKeyValue
Date Fri, 09 Oct 2015 04:09:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949864#comment-14949864
] 

Jerry He commented on HBASE-14557:
----------------------------------

I applied the patch.  The patch works great. It fixed the problem.

One question. The fix is in the ensureKeyValue().  Is this too broad? Meaning in places where
it is used, there may be no need to do any checking of child class and map it?
You are the expert on this area though :-)

> MapReduce WALPlayer issue with NoTagsKeyValue
> ---------------------------------------------
>
>                 Key: HBASE-14557
>                 URL: https://issues.apache.org/jira/browse/HBASE-14557
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Jerry He
>         Attachments: HBASE-14557.patch
>
>
> Running MapReduce WALPlayer to convert WAL into HFiles:
> {noformat}
> 15/10/05 20:28:08 INFO mapred.JobClient: Task Id : attempt_201508031611_0029_m_000000_0,
Status : FAILED
> java.io.IOException: Type mismatch in value from map: expected org.apache.hadoop.hbase.KeyValue,
recieved org.apache.hadoop.hbase.NoTagsKeyValue
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:997)
>         at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:689)
>         at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
>         at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
>         at org.apache.hadoop.hbase.mapreduce.WALPlayer$WALKeyValueMapper.map(WALPlayer.java:111)
>         at org.apache.hadoop.hbase.mapreduce.WALPlayer$WALKeyValueMapper.map(WALPlayer.java:96)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:140)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:368)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>         at java.security.AccessController.doPrivileged(AccessController.java:369)
>         at javax.security.auth.Subject.doAs(Subject.java:572)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1502)
>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message