spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaditya Ramesh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-13027) Add API for updateStateByKey to provide batch time as input
Date Wed, 27 Jan 2016 03:11:39 GMT
Aaditya Ramesh created SPARK-13027:
--------------------------------------

             Summary: Add API for updateStateByKey to provide batch time as input
                 Key: SPARK-13027
                 URL: https://issues.apache.org/jira/browse/SPARK-13027
             Project: Spark
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 1.6.0
            Reporter: Aaditya Ramesh


The StateDStream currently does not provide the batch time as input to the state update function.
This is required in cases where the behavior depends on the batch start time.

We (Conviva) have been patching it manually for the past several Spark versions but we thought
it might be useful for others as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message