spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tathagata Das (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-4027) Write Ahead Log backed Block RDD
Date Thu, 30 Oct 2014 21:54:33 GMT

     [ https://issues.apache.org/jira/browse/SPARK-4027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tathagata Das updated SPARK-4027:
---------------------------------
    Summary: Write Ahead Log backed Block RDD  (was: HDFS backed Block RDD)

> Write Ahead Log backed Block RDD
> --------------------------------
>
>                 Key: SPARK-4027
>                 URL: https://issues.apache.org/jira/browse/SPARK-4027
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Streaming
>            Reporter: Tathagata Das
>            Assignee: Tathagata Das
>            Priority: Critical
>
> As part of the initiative of preventing data loss on streaming driver failure, this sub-task
implements a BlockRDD that is backed by HDFS. This BlockRDD can either read data from the
Spark's BlockManager, or read the data from file-segments in HDFS. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message