spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jascha Swisher (JIRA)" <>
Subject [jira] [Created] (SPARK-4222) FixedLengthBinaryRecordReader should readFully
Date Tue, 04 Nov 2014 18:35:35 GMT
Jascha Swisher created SPARK-4222:

             Summary: FixedLengthBinaryRecordReader should readFully
                 Key: SPARK-4222
             Project: Spark
          Issue Type: Bug
            Reporter: Jascha Swisher
            Priority: Minor

The new FixedLengthBinaryRecordReader currently uses a read() call to read from the FSDataInputStream,
without checking the number of bytes actually returned. The currentPosition variable is updated
assuming that the full number of requested bytes are returned, which could lead to data corruption
or other problems if fewer bytes come back than requested.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message