hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5564) hadoop command uses large JVM heap size
Date Tue, 24 Mar 2009 19:33:52 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12688815#action_12688815
] 

Steve Loughran commented on HADOOP-5564:
----------------------------------------

has anyone tested that everyting works ok on a 64 bit JVM? one with pointers twice the size?

> hadoop command uses large JVM heap size
> ---------------------------------------
>
>                 Key: HADOOP-5564
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5564
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: build
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>            Priority: Blocker
>             Fix For: 0.20.0, 0.21.0
>
>         Attachments: 5564.patch, 5564.trunk.patch, 5564.trunk.patch
>
>
> Command used to determine JAVA_PLATFORM in bin/hadoop command does not set the heap size.
The command uses default 1GB heap size. The tasks invoking hadoop command end up  using large
heap size in streaming jobs. If the maximum memory that can be used by a task is restricted,
this could result in map/reduce job failures.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message