spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tathagata Das (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-10142) Python Streaming checkpoint recovery does not work with non-local file path
Date Mon, 24 Aug 2015 02:25:46 GMT

     [ https://issues.apache.org/jira/browse/SPARK-10142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tathagata Das resolved SPARK-10142.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.0

> Python Streaming checkpoint recovery does not work with non-local file path
> ---------------------------------------------------------------------------
>
>                 Key: SPARK-10142
>                 URL: https://issues.apache.org/jira/browse/SPARK-10142
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark, Streaming
>    Affects Versions: 1.3.1, 1.4.1
>            Reporter: Tathagata Das
>            Assignee: Tathagata Das
>            Priority: Critical
>             Fix For: 1.5.0
>
>
> The Python code in StreamingContext.getOrCreate() check whether the give checkpointPath
exists on local file system. The solution is to use the same code path as Java to verify whether
the valid checkpoint is present or not



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message