hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2941) Streaming map task is not failed when the subprocess exited abnormally.
Date Wed, 05 Mar 2008 09:33:40 GMT
Streaming map task is not failed when the subprocess exited abnormally.
-----------------------------------------------------------------------

                 Key: HADOOP-2941
                 URL: https://issues.apache.org/jira/browse/HADOOP-2941
             Project: Hadoop Core
          Issue Type: Bug
          Components: contrib/streaming
            Reporter: Amareshwari Sriramadasu
             Fix For: 0.17.0


The launched streaming process exited with a non-zero exit code. But the task was succesful.
thereby, job was succesful.

Job tracker logs show: 
08/03/05 14:30:43 INFO mapred.TaskTracker: Task task_200803051430_0001_m_000000_1 is done.
08/03/05 14:30:43 INFO mapred.TaskRunner: Saved output of task 'task_200803051430_0001_m_000000_1'
to hdfs://localhost:46796/testing/out
08/03/05 14:30:43 INFO mapred.JobInProgress: Task 'task_200803051430_0001_m_000000_1' has
completed tip_200803051430_0001_m_000000 successfully.

But the syslog of the task has :
2008-03-05 14:30:43,174 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed.waitOutputThreads():
subprocess failed with code 1 in org.apache.hadoop.streaming.PipeMapRed

We could not know whether the job was successful or not, until we validate the output and
found that there is no output.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message