hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Field (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6343) JobConf.parseMaximumHeapSizeMB() fails to parse value greater than 2GB expressed in bytes
Date Tue, 28 Apr 2015 00:19:07 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516014#comment-14516014
] 

Jeff Field commented on MAPREDUCE-6343:
---------------------------------------

Just ran into this on our development environment using CDH5.4.0:

2015-04-28 00:08:52,427 FATAL [AsyncDispatcher event handler] org.apache.hadoop.yarn.event.AsyncDispatcher:
Error in dispatcher thread
java.lang.NumberFormatException: For input string: "2147483648"
  at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
  at java.lang.Integer.parseInt(Integer.java:499)
  at java.lang.Integer.parseInt(Integer.java:527)
  at org.apache.hadoop.mapred.JobConf.parseMaximumHeapSizeMB(JobConf.java:2105

Changing it to 2147483647 works.

> JobConf.parseMaximumHeapSizeMB() fails to parse value greater than 2GB expressed in bytes
> -----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6343
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6343
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: Hao Xia
>         Attachments: parse-heap-size.patch
>
>
> It currently tries to parse the value as an integer, which blows up whenever the value
is greater than 2GB and expressed in bytes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message