hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3280) virtual address space limits break streaming apps
Date Sat, 26 Apr 2008 00:37:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12592537#action_12592537

Hadoop QA commented on HADOOP-3280:

+1 overall.  Here are the results of testing the latest attachment 
against trunk revision 645773.

    @author +1.  The patch does not contain any @author tags.

    tests included +1.  The patch appears to include 11 new or modified tests.

    javadoc +1.  The javadoc tool did not generate any warning messages.

    javac +1.  The applied patch does not generate any new javac compiler warnings.

    release audit +1.  The applied patch does not generate any new release audit warnings.

    findbugs +1.  The patch does not introduce any new Findbugs warnings.

    core tests +1.  The patch passed core unit tests.

    contrib tests +1.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2333/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2333/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2333/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2333/console

This message is automatically generated.

> virtual address space limits break streaming apps
> -------------------------------------------------
>                 Key: HADOOP-3280
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3280
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Rick Cox
>            Assignee: Arun C Murthy
>            Priority: Blocker
>             Fix For: 0.17.0
>         Attachments: HADOOP-3280_0_20080418.patch, HADOOP-3280_1_20080423.patch, HADOOP-3280_2_20080424.patch,
HADOOP-3280_3_20080425.patch, patch-3280-1.txt, patch-3280-2.txt, patch-3280-3.txt, patch-3280.txt,
> HADOOP-2765 added a mandatory, hard virtual address space limit to streaming apps based
on the Java process's -Xmx setting.
> This makes it impossible to run a 64-bit streaming app that needs large address spaces
under a 32-bit JVM, even if one is otherwise willing to dramatically increase the -Xmx setting
without cause. Also, unlike Java's -Xmx limit, the virtual address space limit for an arbitrary
UNIX process does not necessarily correspond to RAM usage, so it's likely to be a relatively
difficult to configure limit.
> 2765 was originally opened to allow an optional wrapper script around streaming tasks,
one use case for which was setting a ulimit. That approach seems much less intrusive and more
flexible than the final implementation. The ulimit can also be trivially set by the streaming
task itself without any support from Hadoop.
> Marking this as an 0.17 blocker because it will break deployed apps and there is no workaround

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message