flink-user-zh mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "rockeycui@163.com" <rockey...@163.com>
Subject flink kafka相关任务执行出错 导致 taskmanager 退出
Date Thu, 25 Jul 2019 09:12:42 GMT
你好,flink 运行过程中出现以下异常,有何建议指导排除异常,

2019-07-23 10:52:01,420 INFO  org.apache.kafka.common.utils.AppInfoParser                
  - Kafka version : 0.9.0.1
2019-07-23 10:52:01,420 INFO  org.apache.kafka.common.utils.AppInfoParser                
  - Kafka commitId : 23c69d62a0cabf06
2019-07-23 10:52:01,560 INFO  org.apache.flink.runtime.taskmanager.Task                  
  - Attempting to cancel task Source: Custom Source -> Map -> Filter -> Map ->
Map -> to: Row -> Map -> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034).
2019-07-23 10:52:01,560 INFO  org.apache.flink.runtime.taskmanager.Task                  
  - Source: Custom Source -> Map -> Filter -> Map -> Map -> to: Row -> Map
-> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034) switched from RUNNING to CANCELING.
2019-07-23 10:52:01,560 INFO  org.apache.flink.runtime.taskmanager.Task                  
  - Triggering cancellation of task code Source: Custom Source -> Map -> Filter ->
Map -> Map -> to: Row -> Map -> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034).
2019-07-23 10:52:01,563 INFO  org.apache.kafka.clients.producer.KafkaProducer            
  - Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
2019-07-23 10:52:01,571 INFO  org.apache.flink.runtime.taskmanager.Task                  
  - Source: Custom Source -> Map -> Filter -> Map -> Map -> to: Row -> Map
-> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034) switched from CANCELING to CANCELED.
2019-07-23 10:52:01,571 INFO  org.apache.flink.runtime.taskmanager.Task                  
  - Freeing task resources for Source: Custom Source -> Map -> Filter -> Map ->
Map -> to: Row -> Map -> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034).
2019-07-23 10:52:01,572 INFO  org.apache.flink.runtime.taskmanager.Task                  
  - Ensuring all FileSystem streams are closed for task Source: Custom Source -> Map ->
Filter -> Map -> Map -> to: Row -> Map -> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034)
[CANCELED]
2019-07-23 10:52:01,572 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor         
  - Un-registering task and sending final execution state CANCELED to JobManager for task
Source: Custom Source -> Map -> Filter -> Map -> Map -> to: Row -> Map ->
Sink: Unnamed 02dd0b294a75cb672899e83c53985034.
2019-07-23 10:52:01,574 ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler    
  - FATAL: Thread 'flink-metrics-57' produced an uncaught exception. Stopping the process...
java.lang.NoClassDefFoundError: org/apache/kafka/common/metrics/stats/Rate$1
at org.apache.kafka.common.metrics.stats.Rate.convert(Rate.java:98)
at org.apache.kafka.common.metrics.stats.Rate.measure(Rate.java:67)
at org.apache.kafka.common.metrics.KafkaMetric.value(KafkaMetric.java:61)
at org.apache.kafka.common.metrics.KafkaMetric.value(KafkaMetric.java:52)
at org.apache.flink.streaming.connectors.kafka.internal.metrics.KafkaMetricMutableWrapper.getValue(KafkaMetricMutableWrapper.java:39)
at org.apache.flink.streaming.connectors.kafka.internal.metrics.KafkaMetricMutableWrapper.getValue(KafkaMetricMutableWrapper.java:29)
at org.apache.flink.runtime.metrics.dump.MetricDumpSerialization.serializeGauge(MetricDumpSerialization.java:254)
at org.apache.flink.runtime.metrics.dump.MetricDumpSerialization.access$200(MetricDumpSerialization.java:53)
at org.apache.flink.runtime.metrics.dump.MetricDumpSerialization$MetricDumpSerializer.serialize(MetricDumpSerialization.java:166)
at org.apache.flink.runtime.metrics.dump.MetricQueryService.onReceive(MetricQueryService.java:118)
at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165)
at akka.actor.Actor$class.aroundReceive(Actor.scala:502)
at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)
at akka.actor.ActorCell.invoke(ActorCell.scala:495)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
at akka.dispatch.Mailbox.run(Mailbox.scala:224)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.metrics.stats.Rate$1
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader.loadClass(FlinkUserCodeClassLoaders.java:129)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 20 more
2019-07-23 10:52:01,576 INFO  org.apache.flink.runtime.blob.TransientBlobCache           
  - Shutting down BLOB cache
2019-07-23 10:52:01,576 INFO  org.apache.flink.runtime.blob.PermanentBlobCache           
  - Shutting down BLOB cache
2019-07-23 10:52:01,577 INFO  org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager
 - Shutting down TaskExecutorLocalStateStoresManager.
2019-07-23 10:52:01,580 INFO  org.apache.flink.runtime.io.disk.iomanager.IOManager       
  - I/O manager removed spill file directory /tmp/flink-io-3e88d484-6424-4ae6-8eae-1694fa1ed526




rockeycui@163.com
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message