hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Clampffer (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9453) Fix protobuf runtime warnings
Date Mon, 23 Nov 2015 23:02:11 GMT
James Clampffer created HDFS-9453:

             Summary: Fix protobuf runtime warnings
                 Key: HDFS-9453
                 URL: https://issues.apache.org/jira/browse/HDFS-9453
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: James Clampffer
            Assignee: James Clampffer

When performing reads sometimes this warning shows up on stdout or stderr:
"Encountered string containing invalid UTF-8 data while serializing protocol buffer. Strings
must contain only UTF-8; use the 'bytes' type for raw bytes"

Apparently this is most likely due to nulls embedded in a string field.

Running in gdb and breaking on wire_format.cc line 1053 gets a useful stack.  It looks like
RemoteBlockReader::async_connect eventually makes a hadoop::hdfs::ClientOperationHeaderProto
and VerifyUTF8String errors out.

This message was sent by Atlassian JIRA

View raw message