flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuan Nguyen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-8485) Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0
Date Wed, 24 Jan 2018 16:26:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337852#comment-16337852
] 

Xuan Nguyen commented on FLINK-8485:
------------------------------------

Hi [~till.rohrmann] and [~StephanEwen]
 # I generated the quickstart using: 

{code:java}
mvn archetype:generate -DarchetypeGroupId=org.apache.flink -DarchetypeArtifactId=flink-quickstart-java
-DarchetypeVersion=1.4.0{code}

 # Opened the project in Intellij
 # Ran the WordCount inside Intellij

Here is my log with *log4j.logger.org.apache.flink.runtime.jobmanager.JobManager=trace* debugger
on:
{code}
/usr/lib/jvm/java-8-oracle/bin/java -javaagent:/home/xuan/java/idea/lib/idea_rt.jar=36285:/home/xuan/java/idea/bin
-Dfile.encoding=UTF-8 -classpath /usr/lib/jvm/java-8-oracle/jre/lib/charsets.jar:/usr/lib/jvm/java-8-oracle/jre/lib/deploy.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/cldrdata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/dnsns.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jaccess.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jfxrt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/localedata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/nashorn.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunec.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunjce_provider.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunpkcs11.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/zipfs.jar:/usr/lib/jvm/java-8-oracle/jre/lib/javaws.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jce.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfr.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfxswt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jsse.jar:/usr/lib/jvm/java-8-oracle/jre/lib/management-agent.jar:/usr/lib/jvm/java-8-oracle/jre/lib/plugin.jar:/usr/lib/jvm/java-8-oracle/jre/lib/resources.jar:/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar:/home/xuan/git/test/oracle-flink/target/classes:/home/xuan/.m2/repository/org/apache/flink/flink-core/1.4.0/flink-core-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-annotations/1.4.0/flink-annotations-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-metrics-core/1.4.0/flink-metrics-core-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-asm/5.0.4-2.0/flink-shaded-asm-5.0.4-2.0.jar:/home/xuan/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/xuan/.m2/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/home/xuan/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/xuan/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/xuan/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/xuan/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/xuan/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/xuan/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.3/snappy-java-1.1.1.3.jar:/home/xuan/.m2/repository/org/slf4j/slf4j-api/1.7.7/slf4j-api-1.7.7.jar:/home/xuan/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/xuan/.m2/repository/org/apache/flink/force-shading/1.4.0/force-shading-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-java/1.4.0/flink-java-1.4.0.jar:/home/xuan/.m2/repository/org/apache/commons/commons-math3/3.5/commons-math3-3.5.jar:/home/xuan/.m2/repository/org/apache/flink/flink-clients_2.11/1.4.0/flink-clients_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-runtime_2.11/1.4.0/flink-runtime_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-queryable-state-client-java_2.11/1.4.0/flink-queryable-state-client-java_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-hadoop-fs/1.4.0/flink-hadoop-fs-1.4.0.jar:/home/xuan/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-netty/4.0.27.Final-2.0/flink-shaded-netty-4.0.27.Final-2.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-jackson/2.7.9-2.0/flink-shaded-jackson-2.7.9-2.0.jar:/home/xuan/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/xuan/.m2/repository/org/scala-lang/scala-library/2.11.11/scala-library-2.11.11.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-actor_2.11/2.4.20/akka-actor_2.11-2.4.20.jar:/home/xuan/.m2/repository/com/typesafe/config/1.3.0/config-1.3.0.jar:/home/xuan/.m2/repository/org/scala-lang/modules/scala-java8-compat_2.11/0.7.0/scala-java8-compat_2.11-0.7.0.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-stream_2.11/2.4.20/akka-stream_2.11-2.4.20.jar:/home/xuan/.m2/repository/org/reactivestreams/reactive-streams/1.0.0/reactive-streams-1.0.0.jar:/home/xuan/.m2/repository/com/typesafe/ssl-config-core_2.11/0.2.1/ssl-config-core_2.11-0.2.1.jar:/home/xuan/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-protobuf_2.11/2.4.20/akka-protobuf_2.11-2.4.20.jar:/home/xuan/.m2/repository/com/typesafe/akka/akka-slf4j_2.11/2.4.20/akka-slf4j_2.11-2.4.20.jar:/home/xuan/.m2/repository/org/clapper/grizzled-slf4j_2.11/1.0.2/grizzled-slf4j_2.11-1.0.2.jar:/home/xuan/.m2/repository/com/github/scopt/scopt_2.11/3.5.0/scopt_2.11-3.5.0.jar:/home/xuan/.m2/repository/com/twitter/chill_2.11/0.7.4/chill_2.11-0.7.4.jar:/home/xuan/.m2/repository/com/twitter/chill-java/0.7.4/chill-java-0.7.4.jar:/home/xuan/.m2/repository/org/apache/flink/flink-optimizer_2.11/1.4.0/flink-optimizer_2.11-1.4.0.jar:/home/xuan/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/home/xuan/.m2/repository/org/apache/flink/flink-streaming-java_2.11/1.4.0/flink-streaming-java_2.11-1.4.0.jar:/home/xuan/.m2/repository/org/apache/flink/flink-shaded-guava/18.0-2.0/flink-shaded-guava-18.0-2.0.jar:/home/xuan/.m2/repository/org/apache/sling/org.apache.sling.commons.json/2.0.6/org.apache.sling.commons.json-2.0.6.jar:/home/xuan/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar:/home/xuan/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar
oracle.flink.WordCount
09:09:04,771 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has 0 registered
types and 0 default Kryo serializers
09:09:04,779 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered Kryo types:
[]
09:09:04,780 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered Kryo with Serializers
types: []
09:09:04,780 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered Kryo with Serializer
Classes types: []
09:09:04,780 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered Kryo default
Serializers: []
09:09:04,784 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered Kryo default
Serializers Classes []
09:09:04,784 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Registered POJO types:
[]
09:09:04,786 DEBUG org.apache.flink.api.java.ExecutionEnvironment - Static code analysis mode:
DISABLE
09:09:06,358 INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster - Starting FlinkMiniCluster.
09:09:06,383 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter
configured, no metrics will be exposed/reported.
09:09:08,832 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
09:09:08,872 DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
09:09:08,892 DEBUG akka.event.EventStream - Default Loggers started
09:09:09,036 DEBUG org.apache.flink.runtime.jobmanager.JobManager - No archive directory was
configured. Jobs will not be archived.
09:09:09,078 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory
/tmp/blobStore-4eb6c322-ceea-4b73-81bb-8b55705513ac
09:09:09,096 DEBUG org.apache.flink.util.NetUtils - Trying to open socket on port 0
09:09:09,098 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:42001
- max concurrent requests: 50 - max backlog: 1000
09:09:09,470 INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started memory archivist
akka://flink/user/archive_1
09:09:09,483 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager at
akka://flink/user/jobmanager_1.
09:09:09,484 INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Proposing leadership to contender org.apache.flink.runtime.jobmanager.JobManager@4f8086ab
@ akka://flink/user/jobmanager_1
09:09:09,524 INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages
have a max timeout of 10000 ms
09:09:09,527 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received message GrantLeadership(Some(47bf28f8-07c4-449e-9e1f-f437326dc9e4))
at akka://flink/user/jobmanager_1 from Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:09,537 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file
directory '/tmp': total 19 GB, usable 3 GB (15.79% usable)
09:09:09,605 INFO org.apache.flink.runtime.jobmanager.JobManager - JobManager akka://flink/user/jobmanager_1
was granted leadership with leader session ID Some(47bf28f8-07c4-449e-9e1f-f437326dc9e4).
09:09:09,616 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled message GrantLeadership(Some(47bf28f8-07c4-449e-9e1f-f437326dc9e4))
in 88 ms from Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:09,617 INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Received confirmation of leadership for leader akka://flink/user/jobmanager_1 , session=47bf28f8-07c4-449e-9e1f-f437326dc9e4
09:09:10,596 DEBUG org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Received new leading JobManager akka://flink/user/jobmanager_1. Connecting.
09:09:10,641 INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Trying to associate with JobManager leader akka://flink/user/jobmanager_1
09:09:10,681 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received message LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterResourceManager
akka://flink/user/resourcemanager_1) at akka://flink/user/jobmanager_1 from Actor[akka://flink/temp/$a].
09:09:10,686 DEBUG org.apache.flink.runtime.jobmanager.JobManager - Resource manager registration:
RegisterResourceManager akka://flink/user/resourcemanager_1
09:09:10,736 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled message LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterResourceManager
akka://flink/user/resourcemanager_1) in 54 ms from Actor[akka://flink/temp/$a].
09:09:10,742 INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- Resource Manager associating with leading JobManager Actor[akka://flink/user/jobmanager_1#-1543801343]
- leader session 47bf28f8-07c4-449e-9e1f-f437326dc9e4
09:09:12,256 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated
117 MB for network buffer pool (number of memory segments: 3771, bytes per segment: 32768).
09:09:12,289 WARN org.apache.flink.runtime.query.QueryableStateUtils - Could not load Queryable
State Client Proxy. Probable reason: flink-queryable-state-runtime is not in the classpath.
Please put the corresponding jar from the opt to the lib folder.
09:09:12,290 DEBUG org.apache.flink.runtime.query.QueryableStateUtils - Caught exception
java.lang.ClassNotFoundException: org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flink.runtime.query.QueryableStateUtils.createKvStateClientProxy(QueryableStateUtils.java:67)
at org.apache.flink.runtime.taskexecutor.TaskManagerServices.createNetworkEnvironment(TaskManagerServices.java:339)
at org.apache.flink.runtime.taskexecutor.TaskManagerServices.fromConfiguration(TaskManagerServices.java:159)
at org.apache.flink.runtime.minicluster.LocalFlinkMiniCluster.startTaskManager(LocalFlinkMiniCluster.scala:240)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:388)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:381)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:381)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:323)
at org.apache.flink.client.LocalExecutor.start(LocalExecutor.java:116)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:176)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:91)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:815)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
at org.apache.flink.api.java.DataSet.print(DataSet.java:1652)
at oracle.flink.WordCount.main(WordCount.java:66)
09:09:12,296 WARN org.apache.flink.runtime.query.QueryableStateUtils - Could not load Queryable
State Server. Probable reason: flink-queryable-state-runtime is not in the classpath. Please
put the corresponding jar from the opt to the lib folder.
09:09:12,297 DEBUG org.apache.flink.runtime.query.QueryableStateUtils - Caught exception
java.lang.ClassNotFoundException: org.apache.flink.queryablestate.server.KvStateServerImpl
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flink.runtime.query.QueryableStateUtils.createKvStateServer(QueryableStateUtils.java:121)
at org.apache.flink.runtime.taskexecutor.TaskManagerServices.createNetworkEnvironment(TaskManagerServices.java:352)
at org.apache.flink.runtime.taskexecutor.TaskManagerServices.fromConfiguration(TaskManagerServices.java:159)
at org.apache.flink.runtime.minicluster.LocalFlinkMiniCluster.startTaskManager(LocalFlinkMiniCluster.scala:240)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:388)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster$$anonfun$3.apply(FlinkMiniCluster.scala:381)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:381)
at org.apache.flink.runtime.minicluster.FlinkMiniCluster.start(FlinkMiniCluster.scala:323)
at org.apache.flink.client.LocalExecutor.start(LocalExecutor.java:116)
at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:176)
at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:91)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:815)
at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
at org.apache.flink.api.java.DataSet.print(DataSet.java:1652)
at oracle.flink.WordCount.main(WordCount.java:66)
09:09:12,305 INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Starting the network
environment and its components.
09:09:12,305 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Starting network
connection manager
09:09:12,312 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Limiting managed
memory to 368 MB, memory will be allocated lazily.
09:09:12,320 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses
directory /tmp/flink-io-c5861126-7acd-4955-a153-53e18143e6a4 for spill files.
09:09:12,326 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory
/tmp/flink-dist-cache-2ffbed5d-5787-4c69-84a4-12458ad3132e
09:09:12,343 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory
/tmp/flink-dist-cache-a7924e73-47c9-4bec-84ee-1a46f15ed0ba
09:09:12,367 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager
actor at akka://flink/user/taskmanager_1#1824280464.
09:09:12,368 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager data connection
information: 0c13659ec41b6d6f689cb5a12c92e49f @ localhost (dataPort=-1)
09:09:12,368 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager has 1 task
slot(s).
09:09:12,370 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP:
131/158/1185 MB, NON HEAP: 25/25/-1 MB (used/committed/max)]
09:09:12,390 INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to register at
JobManager akka://flink/user/jobmanager_1 (attempt 1, timeout: 500 milliseconds)
09:09:12,396 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received message LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterTaskManager(0c13659ec41b6d6f689cb5a12c92e49f,0c13659ec41b6d6f689cb5a12c92e49f
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168, managed=385875968,1))
at akka://flink/user/jobmanager_1 from Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:12,397 DEBUG org.apache.flink.runtime.jobmanager.JobManager - RegisterTaskManager: RegisterTaskManager(0c13659ec41b6d6f689cb5a12c92e49f,0c13659ec41b6d6f689cb5a12c92e49f
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168, managed=385875968,1)
09:09:12,403 INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager
at localhost (akka://flink/user/taskmanager_1) as 53ed38b0fc8b30aeb39e9f463690eae9. Current
number of registered hosts is 1. Current number of alive task slots is 1.
09:09:12,406 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled message LeaderSessionMessage(47bf28f8-07c4-449e-9e1f-f437326dc9e4,RegisterTaskManager(0c13659ec41b6d6f689cb5a12c92e49f,0c13659ec41b6d6f689cb5a12c92e49f
@ localhost (dataPort=-1),cores=1, physMem=5136220160, heap=1242759168, managed=385875968,1))
in 9 ms from Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:12,406 INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager
- TaskManager 0c13659ec41b6d6f689cb5a12c92e49f has started.
09:09:12,411 INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful registration
at JobManager (akka://flink/user/jobmanager_1), starting network stack and library cache.
09:09:12,425 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server
address to be localhost/127.0.0.1:42001. Starting BLOB cache.
09:09:12,429 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created BLOB cache storage
directory /tmp/blobStore-2a0b756e-eec1-40e4-bb79-442832d2f296
09:09:12,432 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage
directory /tmp/blobStore-426e19d6-b99a-401b-9117-0bb837521b31
09:09:12,454 DEBUG org.apache.flink.optimizer.Optimizer - Beginning compilation of program
'Flink Java Job at Wed Jan 24 09:09:04 MST 2018'
09:09:12,454 DEBUG org.apache.flink.optimizer.Optimizer - Using a default parallelism of 1
09:09:12,454 DEBUG org.apache.flink.optimizer.Optimizer - Using default data exchange mode
PIPELINED
09:09:12,848 DEBUG org.apache.flink.optimizer.Optimizer - Assigned 0.5 of total memory to
each local strategy instance of Channel (GroupCombine "SUM(1), at main(WordCount.java:63"
: SORTED_GROUP_COMBINE [[ GlobalProperties [partitioning=RANDOM_PARTITIONED] ]] [[ LocalProperties
[ordering=null, grouped=null, unique=null] ]]) -> (GroupReduce "SUM(1), at main(WordCount.java:63"
: SORTED_GROUP_REDUCE [[ GlobalProperties [partitioning=HASH_PARTITIONED, on fields [0]] ]]
[[ LocalProperties [ordering=[0:ASC], grouped=[0], unique=null] ]])[PARTITION_HASH] [COMBININGSORT]
{NO-TEMP}.
09:09:12,848 DEBUG org.apache.flink.optimizer.Optimizer - Assigned 0.5 of total memory to
each subtask of SUM(1), at main(WordCount.java:63.
09:09:12,912 DEBUG org.apache.flink.runtime.taskmanager.TaskManager - TaskManager was triggered
to register at JobManager, but is already registered
09:09:13,265 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Disconnect from
JobManager null.
09:09:13,273 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Received SubmitJobAndWait(JobGraph(jobId:
6b74599c3fcca85adce4caa33a5e2697)) but there is no connection to a JobManager yet.
09:09:13,273 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Received job
Flink Java Job at Wed Jan 24 09:09:04 MST 2018 (6b74599c3fcca85adce4caa33a5e2697).
09:09:13,280 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Connect to JobManager
Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:13,281 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Connected to
JobManager at Actor[akka://flink/user/jobmanager_1#-1543801343] with leader session id 47bf28f8-07c4-449e-9e1f-f437326dc9e4.
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#-1543801343] with leader session
id 47bf28f8-07c4-449e-9e1f-f437326dc9e4.
09:09:13,281 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Sending message
to JobManager akka://flink/user/jobmanager_1 to submit job Flink Java Job at Wed Jan 24 09:09:04
MST 2018 (6b74599c3fcca85adce4caa33a5e2697) and wait for progress
09:09:13,978 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Upload jar files
to job manager akka://flink/user/jobmanager_1.
09:09:24,022 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received message RequestBlobManagerPort
at akka://flink/user/jobmanager_1 from Actor[akka://flink/temp/$c].
09:09:24,034 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled message RequestBlobManagerPort
in 10 ms from Actor[akka://flink/temp/$c].
09:09:24,034 DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to
JobManager
09:09:24,036 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received message Heartbeat(53ed38b0fc8b30aeb39e9f463690eae9,ArrayBuffer())
at akka://flink/user/jobmanager_1 from Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:24,038 TRACE org.apache.flink.runtime.jobmanager.JobManager - Received heartbeat message
from 53ed38b0fc8b30aeb39e9f463690eae9.
09:09:24,039 TRACE org.apache.flink.runtime.jobmanager.JobManager - Handled message Heartbeat(53ed38b0fc8b30aeb39e9f463690eae9,ArrayBuffer())
in 3 ms from Actor[akka://flink/user/taskmanager_1#1824280464].
09:09:24,050 DEBUG org.apache.flink.runtime.client.JobSubmissionClientActor - Received JobResultFailure
message from JobManager
09:09:24,051 INFO org.apache.flink.runtime.client.JobClient - Job execution failed
09:09:24,051 INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster - Stopping FlinkMiniCluster.
09:09:24,055 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Terminate JobClientActor.
09:09:24,056 INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Disconnect from
JobManager Actor[akka://flink/user/jobmanager_1#-1543801343].
09:09:24,068 INFO org.apache.flink.runtime.taskmanager.TaskManager - Stopping TaskManager
akka://flink/user/taskmanager_1#1824280464.
09:09:24,068 INFO org.apache.flink.runtime.taskmanager.TaskManager - Disassociating from JobManager
09:09:24,070 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
09:09:24,077 INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
09:09:24,077 DEBUG org.apache.flink.runtime.io.disk.iomanager.IOManager - Shutting down I/O
manager.
09:09:24,079 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-c5861126-7acd-4955-a153-53e18143e6a4
09:09:24,079 INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
09:09:24,079 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down
network connection manager
09:09:24,079 DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down
intermediate result partition manager
09:09:24,080 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager -
Releasing 0 partitions because of shutdown.
09:09:24,088 DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager -
Successful shutdown.
09:09:24,102 INFO org.apache.flink.runtime.taskmanager.TaskManager - Task manager akka://flink/user/taskmanager_1
is completely shut down.
09:09:24,110 INFO org.apache.flink.runtime.jobmanager.JobManager - Stopping JobManager akka://flink/user/jobmanager_1.
09:09:24,114 INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:42001
09:09:24,115 DEBUG org.apache.flink.runtime.jobmanager.JobManager - Job manager akka://flink/user/jobmanager_1
is completely stopped.
Exception in thread "main" org.apache.flink.runtime.client.JobSubmissionException: Could not
retrieve BlobServer address.
at org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.TimeoutException
at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
... 9 more

Process finished with exit code 1

{code}


> Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0
> ---------------------------------------------------------------------------------
>
>                 Key: FLINK-8485
>                 URL: https://issues.apache.org/jira/browse/FLINK-8485
>             Project: Flink
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 1.4.0
>            Reporter: Xuan Nguyen
>            Priority: Blocker
>
> I upgraded flink from 1.3.2 to 1.4.0 and my simple test case no longer runs within Intellij
or any other IDE when I click on the "RUN" button.  I'm using JDK 1.8.
> My Dependencies are:
>  
> {code:java}
> dependencies {
> compile group: 'log4j', name: 'log4j', version: '1.2.17' 
> compile 'org.apache.flink:flink-java:1.4.0' 
> compile 'org.apache.flink:flink-streaming-java_2.11:1.4.0' 
> compile 'org.apache.flink:flink-clients_2.11:1.4.0' 
> compile 'org.apache.flink:flink-table_2.11:1.4.0' 
> compile 'org.apache.flink:flink-scala_2.11:1.4.0' 
> compile 'org.apache.flink:flink-streaming-scala_2.11:1.4.0'
> compile 'org.apache.flink:flink-connector-kafka-0.8_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-runtime_2.11:1.4.0'
> compile 'org.apache.flink:flink-queryable-state-client-java__2.11:1.4.0' testCompile
'junit:junit:+'
> }
> {code}
>  
> {{ }}
> {{The exception:}}
> {code:java}
> Exception in thread "main" org.apache.flink.runtime.client.JobSubmissionException: Could
not retrieve BlobServer address. at org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:166)
at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97) at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.ExecutionException: akka.pattern.AskTimeoutException: Ask
timed out on [Actor[akka://flink/user/jobmanager_1#-1662993273]] after [10000 ms]. Sender[null]
sent message of type "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at org.apache.flink.runtime.client.JobSubmissionClientActor$1.call(JobSubmissionClientActor.java:160)
... 9 more Caused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/jobmanager_1#-1662993273]]
after [10000 ms]. Sender[null] sent message of type "org.apache.flink.runtime.messages.JobManagerMessages$RequestBlobManagerPort$".
at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604) at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126)
at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601) at
scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109) at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:329)
at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:280)
at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:284)
at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)
at java.lang.Thread.run(Thread.java:748){code}
>  
> The debug full logs are located in [https://gist.github.com/xuan/e6d4543c478c30d5747428589b03dd03] along
with the test case.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message