hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lohit Vijayarenu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1032) NPE in RackResolve
Date Mon, 05 Aug 2013 23:59:48 GMT

    [ https://issues.apache.org/jira/browse/YARN-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13730167#comment-13730167

Lohit Vijayarenu commented on YARN-1032:

[~zjshen] Yes, documentation does not mention returning null for resolve(), but if you look
into RawScriptBasedMapping::resolve(), failure to resolve rack can return null in atleast
two places, hence the null check. Thanks for pointing out TestRackResolver, I will try to
add a test case.
> NPE in RackResolve
> ------------------
>                 Key: YARN-1032
>                 URL: https://issues.apache.org/jira/browse/YARN-1032
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.0.5-alpha
>         Environment: linux
>            Reporter: Lohit Vijayarenu
>            Priority: Minor
>         Attachments: YARN-1032.1.patch
> We found a case where our rack resolve script was not returning rack due to problem with
resolving host address. This exception was see in RackResolver.java as NPE, ultimately caught
in RMContainerAllocator. 
> {noformat}
> 2013-08-01 07:11:37,708 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
> java.lang.NullPointerException
> 	at org.apache.hadoop.yarn.util.RackResolver.coreResolve(RackResolver.java:99)
> 	at org.apache.hadoop.yarn.util.RackResolver.resolve(RackResolver.java:92)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assignMapsWithLocality(RMContainerAllocator.java:1039)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assignContainers(RMContainerAllocator.java:925)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:861)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$400(RMContainerAllocator.java:681)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:219)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:243)
> 	at java.lang.Thread.run(Thread.java:722)
> {noformat}

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message