flink-user-zh mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "claylin" <1012539...@qq.com>
Subject 回复: 关于从savepoint启动作业报错 migration for MapState currently isn't supported.
Date Fri, 15 Nov 2019 02:09:56 GMT
谢谢,我这边确实修改了状态的schema,现在试下看下




------------------&nbsp;原始邮件&nbsp;------------------
发件人:&nbsp;"Congxian Qiu"<qcx978132955@gmail.com&gt;;
发送时间:&nbsp;2019年11月15日(星期五) 上午10:07
收件人:&nbsp;"user-zh"<user-zh@flink.apache.org&gt;;

主题:&nbsp;Re: 关于从savepoint启动作业报错 migration for MapState currently
isn't supported.



Hi
看上去是 MapState 的 migration 不支持导致的,可以尝试下 1.9,1.9 解决了
MapState 的 value schema
evolution[1]

[1] https://issues.apache.org/jira/browse/FLINK-11947
Best,
Congxian


claylin <1012539884@qq.com&gt; 于2019年11月14日周四 下午9:35写道:

&gt; 从savepoint启动时候报了一下这个错误,用的1.8.1版本大家有遇到过吗,求解决方案
&gt; java.lang.RuntimeException: Error while getting state&nbsp;&nbsp; at
&gt; org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:119)
&gt;&nbsp; at
&gt; org.apache.flink.streaming.api.operators.StreamingRuntimeContext.getMapState(StreamingRuntimeContext.java:179)
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at
&gt; com.yy.kafka.template.job.PushServerRspStatisticsVer3$DistinctProcessFunction.open(PushServerRspStatisticsVer3.java:243)
&gt;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:102)
&gt; at
&gt; org.apache.flink.streaming.api.operators.KeyedProcessOperator.open(KeyedProcessOperator.java:57)
&gt;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424)
&gt;&nbsp;&nbsp; at
&gt; org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290)
&gt;&nbsp;&nbsp;&nbsp;&nbsp; at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
&gt;&nbsp; at java.lang.Thread.run(Thread.java:748) Caused by:
&gt; org.apache.flink.util.StateMigrationException: The new serializer for a
&gt; MapState requires state migration in order for the job to proceed. However,
&gt; migration for MapState currently isn't supported.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
at
&gt; org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.migrateStateValues(RocksDBKeyedStateBackend.java:543)
&gt;&nbsp;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.updateRestoredStateMetaInfo(RocksDBKeyedStateBackend.java:525)
&gt;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.tryRegisterKvStateInformation(RocksDBKeyedStateBackend.java:475)
&gt;&nbsp; at
&gt; org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.createInternalState(RocksDBKeyedStateBackend.java:613)
&gt;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.runtime.state.ttl.TtlStateFactory.createTtlStateContext(TtlStateFactory.java:197)
&gt;&nbsp; at
&gt; org.apache.flink.runtime.state.ttl.TtlStateFactory.createMapState(TtlStateFactory.java:155)
&gt; at
&gt; org.apache.flink.runtime.state.ttl.TtlStateFactory.createState(TtlStateFactory.java:126)
&gt;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.runtime.state.ttl.TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TtlStateFactory.java:71)
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.runtime.state.AbstractKeyedStateBackend.getOrCreateKeyedState(AbstractKeyedStateBackend.java:286)
&gt;&nbsp; at
&gt; org.apache.flink.runtime.state.AbstractKeyedStateBackend.getPartitionedState(AbstractKeyedStateBackend.java:335)
&gt;&nbsp;&nbsp;&nbsp; at
&gt; org.apache.flink.runtime.state.DefaultKeyedStateStore.getPartitionedState(DefaultKeyedStateStore.java:124)
&gt;&nbsp; at
&gt; org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:116)
&gt;&nbsp; ... 9 more
Mime
  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message