spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matei Zaharia (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-4222) FixedLengthBinaryRecordReader should readFully
Date Wed, 05 Nov 2014 23:38:33 GMT

     [ https://issues.apache.org/jira/browse/SPARK-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matei Zaharia updated SPARK-4222:
---------------------------------
    Assignee: Jascha Swisher

> FixedLengthBinaryRecordReader should readFully
> ----------------------------------------------
>
>                 Key: SPARK-4222
>                 URL: https://issues.apache.org/jira/browse/SPARK-4222
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Jascha Swisher
>            Assignee: Jascha Swisher
>            Priority: Minor
>
> The new FixedLengthBinaryRecordReader currently uses a read() call to read from the FSDataInputStream,
without checking the number of bytes actually returned. The currentPosition variable is updated
assuming that the full number of requested bytes are returned, which could lead to data corruption
or other problems if fewer bytes come back than requested.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message