hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yiping Han (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2360) hadoop::RecordReader::read() throws exception in HadoopPipes::RecordWriter
Date Wed, 05 Dec 2007 19:43:43 GMT
hadoop::RecordReader::read() throws exception in HadoopPipes::RecordWriter

                 Key: HADOOP-2360
                 URL: https://issues.apache.org/jira/browse/HADOOP-2360
             Project: Hadoop
          Issue Type: Bug
    Affects Versions: 0.14.3
            Reporter: Yiping Han
            Priority: Blocker

The jute record is in format:

  class SampleValue 
       ustring data;

And in HadoopPipes::RecordWriter::emit(), has code like this:

void SampleRecordWriterC::emit(const std::string& key, const std::string& value)
    if (key.empty() || value.empty()) {

    hadoop::StringInStream key_in_stream(const_cast<std::string&>(key));
    hadoop::RecordReader key_record_reader(key_in_stream, hadoop::kCSV);
    EmitKeyT emit_key;

    hadoop::StringInStream value_in_stream(const_cast<std::string&>(value));
    hadoop::RecordReader value_record_reader(value_in_stream, hadoop::kCSV);
    EmitValueT emit_value;



And the code throw hadoop::IOException at the read() line.

In the mapper, I have faked record emitted by the following code:

std::string value;
EmitValueT emit_value;


hadoop::StringOutStream value_out_stream(value);
hadoop::RecordWriter value_record_writer(value_out_stream, hadoop::kCSV);

We haven't update to the up-to-date version of hadoop. But I've searched the tickets and didn't
find one issuing this problem.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message