spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Armbrust (JIRA)" <>
Subject [jira] [Created] (SPARK-17812) More granular control of starting offsets
Date Thu, 06 Oct 2016 21:01:20 GMT
Michael Armbrust created SPARK-17812:

             Summary: More granular control of starting offsets
                 Key: SPARK-17812
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
            Reporter: Michael Armbrust

Right now you can only run a Streaming Query starting from either the earliest or latests
offsets available at the moment the query is started.  Sometimes this is a lot of data.  It
would be nice to be able to do the following:
 - seek back {{X}} offsets in the stream from the moment the query starts
 - seek to user specified offsets

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message