spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-22255) FileAppender timeout and blocking state
Date Wed, 11 Oct 2017 18:37:00 GMT


Sean Owen commented on SPARK-22255:

You have to block here, right? I'm not clear how you wait on input if you only check available().
There will be points where there are 0 input bytes available but you don't want to stop.

> FileAppender timeout and blocking state
> ----------------------------------------------------------
>                 Key: SPARK-22255
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.2.0
>            Reporter: Mariusz Galus
>            Priority: Minor
> The FileAppender logic when reading from InputStream blocks. This can be simply avoided
with a InputStream.available() check prior to reading. 
> If this is done, a variable for estimated available bytes needs to be instantiated to
use in the conditionals. The conditional for reading from the inputstream and the conditional
for appending to the file.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message