hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5728) Check NPE for serializer/deserializer in MapTask
Date Tue, 10 Mar 2015 04:05:39 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer updated MAPREDUCE-5728:
----------------------------------------
    Fix Version/s:     (was: 2.7.0)
                       (was: 2.4.0)

> Check NPE for serializer/deserializer in MapTask
> ------------------------------------------------
>
>                 Key: MAPREDUCE-5728
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5728
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: client
>    Affects Versions: 2.2.0
>            Reporter: Jerry He
>            Assignee: Jerry He
>            Priority: Minor
>         Attachments: MAPREDUCE-5728-trunk.patch
>
>
> Currently we will get NPE if the serializer/deserializer is not configured correctly.
> {code}
> 14/01/14 11:52:35 INFO mapred.JobClient: Task Id : attempt_201401072154_0027_m_000002_2,
Status : FAILED
> java.lang.NullPointerException
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:944)
>         at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:672)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:740)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:368)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>         at java.security.AccessController.doPrivileged(AccessController.java:362)
>         at javax.security.auth.Subject.doAs(Subject.java:573)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1502)
>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
> {code}
> serializationFactory.getSerializer and serializationFactory.getDeserializer returns NULL
in this case.
> Let's check NPE for serializer/deserializer in MapTask so that we don't get meaningless
NPE.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message