hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yiping Han (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-2360) hadoop::RecordReader::read() throws exception in HadoopPipes::RecordWriter
Date Thu, 06 Dec 2007 23:08:43 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yiping Han resolved HADOOP-2360.
--------------------------------

    Resolution: Cannot Reproduce

> hadoop::RecordReader::read() throws exception in HadoopPipes::RecordWriter
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-2360
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2360
>             Project: Hadoop
>          Issue Type: Bug
>    Affects Versions: 0.14.3
>            Reporter: Yiping Han
>            Priority: Minor
>
> The jute record is in format:
>   class SampleValue 
>   {
>        ustring data;
>   }
> And in HadoopPipes::RecordWriter::emit(), has code like this:
> void SampleRecordWriterC::emit(const std::string& key, const std::string& value)
> {
>     if (key.empty() || value.empty()) {
>         return;
>     }
>     hadoop::StringInStream key_in_stream(const_cast<std::string&>(key));
>     hadoop::RecordReader key_record_reader(key_in_stream, hadoop::kCSV);
>     EmitKeyT emit_key;
>     key_record_reader.read(emit_key);
>     hadoop::StringInStream value_in_stream(const_cast<std::string&>(value));
>     hadoop::RecordReader value_record_reader(value_in_stream, hadoop::kCSV);
>     EmitValueT emit_value;
>     value_record_reader.read(emit_value);
>     return;
> }
> And the code throw hadoop::IOException at the read() line.
> In the mapper, I have faked record emitted by the following code:
> std::string value;
> EmitValueT emit_value;
> emit_value.getData().assign("FakeData");
> hadoop::StringOutStream value_out_stream(value);
> hadoop::RecordWriter value_record_writer(value_out_stream, hadoop::kCSV);
> value_record_writer.write(emit_value);
> We haven't update to the up-to-date version of hadoop. But I've searched the tickets
and didn't find one issuing this problem.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message