hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bochun Bai (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1517) streaming should support running on background
Date Fri, 17 Sep 2010 08:35:33 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bochun Bai updated MAPREDUCE-1517:
----------------------------------

    Attachment: contrib-streaming-background-with-test.patch
                hadoop-mapred-patch-logs.tar.gz

Added TestStreamingBackground.

test-patch report is:
-1 overall.  

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 6 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    -1 release audit.  The applied patch generated 4 release audit warnings (more than the
trunk's current 2 warnings).

    +1 system tests framework.  The patch passed system tests framework compile.



and the "-1 release audit" is:
$ cat releaseAuditDiffWarnings.txt 

1,2d0
< [rat:report]  !????? /data/home/bochun.bai/code/apache/hadoop-mapred-trunk-testwork/build/hadoop-mapred-PATCH-contrib-streaming-background-with-test.patch/src/contrib/streaming/src/test/org/apache/hadoop/streaming/DelayEchoApp.java
< [rat:report]  !????? /data/home/bochun.bai/code/apache/hadoop-mapred-trunk-testwork/build/hadoop-mapred-PATCH-contrib-streaming-background-with-test.patch/src/contrib/streaming/src/test/org/apache/hadoop/streaming/TestStreamingBackground.java


The patch logs is attached.

> streaming should support running on background
> ----------------------------------------------
>
>                 Key: MAPREDUCE-1517
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1517
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/streaming
>            Reporter: Bochun Bai
>         Attachments: contrib-streaming-background-with-test.patch, contrib-streaming-background.patch,
contrib-streaming-background.patch, hadoop-mapred-patch-logs.tar.gz
>
>
> StreamJob submit the job and use a while loop monitor the progress.
> I prefer it running on background.
> Just add "&" at the end of command is a alternative solution, but it keeps a java
process on client machine.
> When submit hundreds jobs at the same time, the client machine is overloaded.
> Adding a -background option to StreamJob, tell it only submit and don't monitor the progress.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message