hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-9744) Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad
Date Thu, 10 Oct 2013 22:59:41 GMT

     [ https://issues.apache.org/jira/browse/HBASE-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jean-Daniel Cryans updated HBASE-9744:
--------------------------------------

    Attachment: HBASE-9744.patch

Attaching the fix, basically moving one line between ImportTsv and HFileOutputFormat.

> Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad
> -----------------------------------------------------------------------------
>
>                 Key: HBASE-9744
>                 URL: https://issues.apache.org/jira/browse/HBASE-9744
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.96.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>             Fix For: 0.96.1
>
>         Attachments: HBASE-9744.patch
>
>
> HFileOutputFormat.configureIncrementalLoad is not setting all the io serializations correctly
so custom bulk loaders (like ImportTsv) need to set it. Simple fix, just add what's missing.
> In case someone doesn't get this patch but upgrades to an old RC, this is what you'll
see when running via YARN (or similar if MR1):
> {noformat}
> 2013-10-10 09:48:13,836 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running
child : java.lang.NullPointerException
>     at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:989)
>     at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:390)
>     at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:79)
>     at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:674)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:746)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339)
>     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:165)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1485)
>     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:160)
> {noformat}
> Kudos to [~jarcec] for finding the issue.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message