hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1029) streaming doesn't work with multiple maps
Date Thu, 22 Feb 2007 17:27:05 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun C Murthy updated HADOOP-1029:
----------------------------------

    Description: StreamInputFormat doesn't 'seek' to the right offset for the split, therefore
leading to a situation where every map reads the same input-split and processes it; also the
StreamLineRecordReader has a bug where it doesn't clear out the contents of previous keys/values
and that data is appended to each subsequent key/value.  (was: StreamInputFormat doesn't 'seek'
to the right offset for the split, therefore leading to a situation where every map reads
the same input-split and processes it; clearly not a happy situation.)
        Summary: streaming doesn't work with multiple maps  (was: StreamInputFormat doesn't
work with multiple maps)

> streaming doesn't work with multiple maps
> -----------------------------------------
>
>                 Key: HADOOP-1029
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1029
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.11.2
>            Reporter: Arun C Murthy
>         Assigned To: Arun C Murthy
>            Priority: Blocker
>             Fix For: 0.12.0
>
>
> StreamInputFormat doesn't 'seek' to the right offset for the split, therefore leading
to a situation where every map reads the same input-split and processes it; also the StreamLineRecordReader
has a bug where it doesn't clear out the contents of previous keys/values and that data is
appended to each subsequent key/value.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message