hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2941) Streaming map task is not failed when the subprocess exited abnormally.
Date Wed, 05 Mar 2008 09:33:40 GMT
Streaming map task is not failed when the subprocess exited abnormally.

                 Key: HADOOP-2941
                 URL: https://issues.apache.org/jira/browse/HADOOP-2941
             Project: Hadoop Core
          Issue Type: Bug
          Components: contrib/streaming
            Reporter: Amareshwari Sriramadasu
             Fix For: 0.17.0

The launched streaming process exited with a non-zero exit code. But the task was succesful.
thereby, job was succesful.

Job tracker logs show: 
08/03/05 14:30:43 INFO mapred.TaskTracker: Task task_200803051430_0001_m_000000_1 is done.
08/03/05 14:30:43 INFO mapred.TaskRunner: Saved output of task 'task_200803051430_0001_m_000000_1'
to hdfs://localhost:46796/testing/out
08/03/05 14:30:43 INFO mapred.JobInProgress: Task 'task_200803051430_0001_m_000000_1' has
completed tip_200803051430_0001_m_000000 successfully.

But the syslog of the task has :
2008-03-05 14:30:43,174 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed.waitOutputThreads():
subprocess failed with code 1 in org.apache.hadoop.streaming.PipeMapRed

We could not know whether the job was successful or not, until we validate the output and
found that there is no output.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message