flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raymond Tay (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-8351) Canonical way to extract FoldingState QueryableStateStream
Date Wed, 03 Jan 2018 01:56:00 GMT
Raymond Tay created FLINK-8351:

             Summary: Canonical way to extract FoldingState QueryableStateStream
                 Key: FLINK-8351
                 URL: https://issues.apache.org/jira/browse/FLINK-8351
             Project: Flink
          Issue Type: Bug
          Components: Queryable State
    Affects Versions: 1.4.0
         Environment: h3. Environment
* Local flink cluster version 1.4.0
* {{classloader.resolve-order: child-first}} in {{conf/flink-conf.yaml}}.
* scala 2.11.11
* oracle jdk 1.8.0

h3. Library version
* akka actors 2.4.20
* akka http 10.0.10
            Reporter: Raymond Tay

I started experimenting with {{QueryableStateStream}} by referencing this site which is linked
by Flink's website ⇒ https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/state/queryable_state.html

I think the example given is perfectly fine and runs w/o much issue. However, i started extrapolating
the situation to have a {{FoldingState}} where the application continuously updates the state
and another part of the application retrieves the state and i ran into the following situation:

* Is there a canonical way or API that allows the app to extract the submitted job-id in order
to query the current state 
** As a work around, i'm querying the url {{localhost:8081/jobs}} but this does not work when
there are other jobs running
* Is there another way to query the state other than {{polling}} ? Is it possible to to return
the final result as part of the {{JobExecutionResult}}
** At the moment, the app is polling the url {{localhost:8081/jobs}} and using that {{JobID}}
to query the state but when the job completes, the job's state is not persisted and i lose
the _final_ state value

I realized {{QueryableStateStream}} is in {{beta}} as of the time of this issue so there are
things i might have missed. Any help or tip is greatly appreciated ☺

This message was sent by Atlassian JIRA

View raw message