flink-user-zh mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jin Yi <eleanore....@gmail.com>
Subject Re: [State Processor API] how to convert savepoint back to broadcast state
Date Mon, 27 Jan 2020 06:50:50 GMT
Hi Yun,

After search around in the documentation, I tried extends
BroadcastProcessFunction implements CheckpointedFunction. And I have
initialized broadcast state in public void
initializeState(FunctionInitializationContext
context) method, it seems working fine.

Here is the doc I followed:
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/state.html#checkpointedfunction

Thanks a lot for your help!
Eleanore

On Sun, Jan 26, 2020 at 6:53 PM Jin Yi <eleanore.jin@gmail.com> wrote:

> Hi Yun,
>
> Thanks for the response, I have checked official document, and I have
> referred this example to write the broadcast state to a savepoint.
>
> My question is: I can use state processor api to read back the savepoint
> into a dataSet, but how can I use the dataSet as the initial value for the
> broadcast state in the BroadcastProcessFunction.
>
> Thanks a lot!
>
> Eleanore
>
> On Sun, Jan 26, 2020 at 8:53 AM Yun Tang <myasuka@live.com> wrote:
>
>> Hi Yi
>>
>> Can the official doc of writing broad cast state [1] satisfies your
>> request?
>>
>> [1]
>> https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html#broadcast-state-1
>>
>> Best
>> Yun Tang
>> ------------------------------
>> *From:* Jin Yi <eleanore.jin@gmail.com>
>> *Sent:* Thursday, January 23, 2020 8:12
>> *To:* user <user@flink.apache.org>; user-zh@flink.apache.org <
>> user-zh@flink.apache.org>
>> *Subject:* [State Processor API] how to convert savepoint back to
>> broadcast state
>>
>> Hi there,
>>
>> I would like to read the savepoints (for broadcast state) back into the
>> broadcast state, how should I do it?
>>
>> // load the existingSavepoint;
>> ExistingSavepoint existingSavepoint = Savepoint.load(environment, "file:///tmp/new_savepoints",
new MemoryStateBackend());
>>
>> // read state from existing savepoint
>> dataSet = existingSavepoint.readBroadcastState(OPERATOR_UID, "largeKeySetStateDescription",
BasicTypeInfo.STRING_TYPE_INFO, BasicTypeInfo.STRING_TYPE_INFO);
>>
>> // TODO in BoradcastProcessFunction, how can I put the savepoint dataset back into
BroadcastState?
>>
>> Thanks!
>>
>> Eleanore
>>
>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message