spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-19306) Fix inconsistent state in DiskBlockObjectWriter when exception occurred
Date Fri, 20 Jan 2017 08:17:26 GMT

     [ https://issues.apache.org/jira/browse/SPARK-19306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-19306:
------------------------------------

    Assignee: Apache Spark

> Fix inconsistent state in DiskBlockObjectWriter when exception occurred
> -----------------------------------------------------------------------
>
>                 Key: SPARK-19306
>                 URL: https://issues.apache.org/jira/browse/SPARK-19306
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.1.0
>            Reporter: Saisai Shao
>            Assignee: Apache Spark
>            Priority: Minor
>
> In {{DiskBlockObjectWriter}}, when some errors happened during writing, it will call
{{revertPartialWritesAndClose}}, if this method again failed due to some hardware issues like
out of disk, it will throw exception without resetting the state of this writer, also skipping
the revert. So here propose to fix this issue to offer user a chance to recover from such
issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message