hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9744) Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad
Date Fri, 11 Oct 2013 13:00:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792582#comment-13792582
] 

Hudson commented on HBASE-9744:
-------------------------------

SUCCESS: Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #788 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/788/])
HBASE-9744 Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad (stack:
rev 1531188)
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/ImportTsv.java


> Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad
> -----------------------------------------------------------------------------
>
>                 Key: HBASE-9744
>                 URL: https://issues.apache.org/jira/browse/HBASE-9744
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.96.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>             Fix For: 0.98.0, 0.96.0
>
>         Attachments: HBASE-9744.patch
>
>
> HFileOutputFormat.configureIncrementalLoad is not setting all the io serializations correctly
so custom bulk loaders (like ImportTsv) need to set it. Simple fix, just add what's missing.
> In case someone doesn't get this patch but upgrades to an old RC, this is what you'll
see when running via YARN (or similar if MR1):
> {noformat}
> 2013-10-10 09:48:13,836 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running
child : java.lang.NullPointerException
>     at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:989)
>     at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:390)
>     at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:79)
>     at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:674)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:746)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339)
>     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:165)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1485)
>     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:160)
> {noformat}
> Kudos to [~jarcec] for finding the issue.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message