flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dulaj Viduranga <vidura...@icloud.com>
Subject Re: Could not build up connection to JobManager
Date Tue, 24 Feb 2015 16:14:27 GMT
Oh, I can’t attach files. Here are my log data

*************************Job manager************************************

21:24:59,837 WARN  org.apache.hadoop.util.NativeCodeLoader                       - Unable
to load native-hadoop library for your platform... using builtin-java classes where applicable
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                - -------------------------------------------------------
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                -  Starting
JobManager (Version: 0.9-SNAPSHOT, Rev:bed3da4, Date:20.02.2015 @ 20:40:35 IST)
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                -  Current
user: Vidura
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                -  JVM: Java
HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.5-b02
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                -  Startup
Options: -Xms768m -Xmx768m 
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                -  Maximum
heap size: 736 MiBytes
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                -  JAVA_HOME:
/Library/Java/JavaVirtualMachines/jdk1.8.0_05.jdk/Contents/Home
21:24:59,924 INFO  org.apache.flink.runtime.jobmanager.JobManager                - -------------------------------------------------------
21:25:00,194 INFO  org.apache.flink.runtime.jobmanager.JobManager                - Starting
JobManager
21:25:00,625 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger
started
21:25:00,675 INFO  Remoting                                                      - Starting
remoting
21:25:00,839 INFO  Remoting                                                      - Remoting
started; listening on addresses :[akka.tcp://flink@10.216.192.98:6123]
21:25:00,856 INFO  org.apache.flink.runtime.blob.BlobServer                      - Created
BLOB server storage directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-efad515a-da85-4c39-afeb-1aef1d965aef
21:25:00,864 INFO  org.apache.flink.runtime.blob.BlobServer                      - Started
BLOB server at 0.0.0.0:49678 - max concurrent requests: 50 - max backlog: 1000
21:25:00,876 INFO  org.apache.flink.runtime.jobmanager.JobManager                - Starting
embedded TaskManager for JobManager's LOCAL mode execution
21:25:00,881 INFO  org.apache.flink.runtime.jobmanager.JobManager                - Starting
JobManager at akka://flink/user/jobmanager.
21:25:00,883 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Using 0.7
of the free heap space for managed memory.
21:25:00,941 INFO  org.apache.flink.runtime.jobmanager.JobManager                - Starting
JobManger web frontend
21:25:00,945 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Starting
task manager at akka://flink/user/taskmanager.
21:25:00,945 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Creating
1 task slot(s).
21:25:00,946 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - TaskManager
connection information 127.0.0.1 (dataPort=49679).
21:25:00,948 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Temporary
file directory '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T': total 232 GB, usable 14
GB (6.03% usable)
21:25:00,951 INFO  org.apache.flink.runtime.io.disk.iomanager.IOManager          - I/O manager
uses directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/flink-io-e9999120-d46d-47f1-8784-094a833cedb1
for spill files.
21:25:00,953 INFO  org.apache.flink.runtime.jobmanager.web.WebInfoServer         - Setting
up web info server, using web-root directoryjar:file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-runtime-0.9-SNAPSHOT.jar!/web-docs-infoserver.
21:25:01,304 INFO  org.eclipse.jetty.util.log                                    - jetty-8.0.0.M1
21:25:01,338 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Profiling
of jobs is disabled.
21:25:01,338 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Memory
usage stats: [HEAP: 523/736/736 MB, NON HEAP: 28/28/-1 MB (used/committed/max)]
21:25:01,342 INFO  org.eclipse.jetty.util.log                                    - Started
SelectChannelConnector@0.0.0.0:8081
21:25:01,342 INFO  org.apache.flink.runtime.jobmanager.web.WebInfoServer         - Started
web info server for JobManager on null:8081
21:25:01,405 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Try to
register at master akka.tcp://flink@10.216.192.98:6123/user/jobmanager. 1. Attempt
21:25:01,410 INFO  org.apache.flink.runtime.instance.InstanceManager             - Registered
TaskManager at 127 (akka://flink/user/taskmanager) as 60cbc9f7d2513d5fdec5b26970d30b85. Current
number of registered hosts is 1.
21:25:01,555 INFO  org.apache.flink.runtime.io.network.buffer.NetworkBufferPool  - Allocated
64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
21:25:01,558 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Determined
BLOB server address to be localhost/10.216.192.98:49678.
21:25:01,559 INFO  org.apache.flink.runtime.blob.BlobCache                       - Created
BLOB cache storage directory /var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/blobStore-575d89fe-e45a-4729-823c-1e24a6c394ad
 
********************************************************************





**********************Webclient***********************************

21:25:09,556 INFO  org.apache.flink.client.web.WebInterfaceServer                - Setting
up web frontend server, using web-root directory 'jar:file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-clients-0.9-SNAPSHOT.jar!/web-docs'.
21:25:09,558 INFO  org.apache.flink.client.web.WebInterfaceServer                - Web frontend
server will store temporary files in '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T', uploaded
jobs in '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-jobs', plan-json-dumps
in '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-plans'.
21:25:09,558 INFO  org.apache.flink.client.web.WebInterfaceServer                - Web-frontend
will submit jobs to nephele job-manager on localhost, port 6123.
21:25:10,231 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger
started
21:25:10,291 INFO  Remoting                                                      - Starting
remoting
21:25:10,469 INFO  Remoting                                                      - Remoting
started; listening on addresses :[akka.tcp://JobsInfoServletActorSystem@127.0.0.1:49683]
21:26:25,710 WARN  Remoting                                                      - Tried to
associate with unreachable remote address [akka.tcp://flink@10.216.192.98:6123]. Address is
now gated for 5000 ms, all messages to this address will be delivered to dead letters. Reason:
Operation timed out: /10.216.192.98:6123
21:26:25,715 ERROR org.apache.flink.client.WebFrontend                           - Unexpected
exception: Could not find job manager at specified address akka.tcp://flink@10.216.192.98:6123/user/jobmanager.
java.lang.RuntimeException: Could not find job manager at specified address akka.tcp://flink@10.216.192.98:6123/user/jobmanager.
	at org.apache.flink.client.web.JobsInfoServlet.<init>(JobsInfoServlet.java:82)
	at org.apache.flink.client.web.WebInterfaceServer.<init>(WebInterfaceServer.java:158)
	at org.apache.flink.client.WebFrontend.main(WebFrontend.java:74)
 
************************************************************************************
> On Feb 24, 2015, at 9:32 PM, Dulaj Viduranga <vidura.me@icloud.com> wrote:
> 
> Hi,
> I still couldn’t figure out a solution. The logs for Jobmanager and webclient follows…
It would be great if someone could take a look… Thanks
> 
> 
> 
>> On Feb 24, 2015, at 1:41 PM, Stephan Ewen <sewen@apache.org> wrote:
>> 
>> Hey Dulaj!
>> 
>> As a contributor, I would go against the latest version, which is
>> 0.9-SNAPSHOT.
>> 
>> It may be in your case that the JobManager actor is down, but the process
>> still lingers. (BTW: I have a patch pending that makes sure the process
>> disappears when the actor via down).
>> 
>> Could you have a look at the log "flink-<user>-jobmanager-<host>-.log"
and
>> see if there are any errors logged?
>> 
>> Greetings,
>> Stephan
>> Am 24.02.2015 06:29 schrieb "Dulaj Viduranga" <vidura.me@icloud.com>:
>> 
>>> The JobManager seems to run fine. I don't know. When I tried to run
>>> start-local.sh again, It shows the PID of the running JobManager and also
>>> :8081 runs fine. I want to contribute to the project and I could get a
>>> little boost if I could see the capabilities of FLINK. :)
>>> Will it be OK to use 0.8.1 as a developer?
>>> 
>>> On Feb 24, 2015, at 04:15 AM, Stephan Ewen <sewen@apache.org> wrote:
>>> 
>>> Hi Dulaj,
>>> 
>>> That error message indicates that the JobManager is not running. Are you
>>> sure that the JobManager runs properly? Anything in the JobManager logs?
>>> 
>>> BTW: The 0.9 branch is under heavy development / changes. That is why it
>>> may behave a bit different on different days right now. I would recommend
>>> to use the 0.8.1 release for a stable experience.
>>> 
>>> Greetings,
>>> Stephan
>>> 
>>> 
>>> On Mon, Feb 23, 2015 at 7:39 PM, Robert Metzger <rmetzger@apache.org>
>>> wrote:
>>> 
>>> Thank you for the quick reply.
>>> 
>>> The log you've send is from the webclient. Can you also send the log of the
>>> 
>>> JobManager?
>>> 
>>> On Mon, Feb 23, 2015 at 7:28 PM, Dulaj Viduranga <vidura.me@icloud.com>
>>> 
>>> wrote:
>>> 
>>>> Yes. It seams it is not a problem with the arguments. I tried two days
>>> 
>>> but
>>> 
>>>> different error occurs. It seams the web client can’t connect to the job
>>> 
>>>> manager although it is running
>>> 
>>>> Right now, I can’t even get the webclient to run.
>>> 
>>> ./bin/start-webclient.sh
>>> 
>>>> executes fine but I cannot connect to localhost:8080 (even with telnet or
>>> 
>>>> curl)
>>> 
>>>> Here is the log for jobManager
>>> 
>>>> 
>>> 
>>>> 23:22:31,933 INFO org.apache.flink.client.web.WebInterfaceServer
>>> 
>>>> - Setting up web frontend server, using web-root directory
>>> 
>>>> 
>>> 
>>> 'jar:
>>> file:/Users/Vidura/Documents/Development/flink/flink-dist/target/flink-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT/lib/flink-clients-0.9-SNAPSHOT.jar!/web-docs
>>> '.
>>> 
>>>> 23:22:31,934 INFO org.apache.flink.client.web.WebInterfaceServer
>>> 
>>>> - Web frontend server will store temporary files in
>>> 
>>>> '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T', uploaded jobs in
>>> 
>>>> '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-jobs',
>>> 
>>>> plan-json-dumps in
>>> 
>>>> '/var/folders/3_/7gzbv7ks7q71lpm5d9hzrw2c0000gn/T/webclient-plans'.
>>> 
>>>> 23:22:31,934 INFO org.apache.flink.client.web.WebInterfaceServer
>>> 
>>>> - Web-frontend will submit jobs to nephele job-manager on
>>> 
>>> localhost,
>>> 
>>>> port 6123.
>>> 
>>>> 23:22:32,580 INFO akka.event.slf4j.Slf4jLogger
>>> 
>>>> - Slf4jLogger started
>>> 
>>>> 23:22:32,625 INFO Remoting
>>> 
>>>> - Starting remoting
>>> 
>>>> 23:22:32,838 INFO Remoting
>>> 
>>>> - Remoting started; listening on addresses :[akka.tcp://
>>> 
>>> 
>>>> JobsInfoServletActorSystem@127.0.0.1:51517]
>>> 
>>>> 23:23:48,119 WARN Remoting
>>> 
>>>> - Tried to associate with unreachable remote address [akka.tcp://
>>> 
>>> 
>>>> flink@10.218.98.169:6123]. Address is now gated for 5000 ms, all
>>> 
>>> messages
>>> 
>>>> to this address will be delivered to dead letters. Reason: Operation
>>> 
>>> timed
>>> 
>>>> out: /10.218.98.169:6123
>>> 
>>>> 23:23:48,124 ERROR org.apache.flink.client.WebFrontend
>>> 
>>>> - Unexpected exception: Could not find job manager at specified
>>> 
>>>> address akka.flink@10.218.98.169:6123/user/jobmanager'>tcp://
>>> flink@10.218.98.169:6123/user/jobmanager.
>>> 
>>>> java.lang.RuntimeException: Could not find job manager at specified
>>> 
>>>> address akka.flink@10.218.98.169:6123/user/jobmanager'>tcp://
>>> flink@10.218.98.169:6123/user/jobmanager.
>>> 
>>>> at
>>> 
>>>> 
>>> 
>>> org.apache.flink.client.web.JobsInfoServlet.<init>(JobsInfoServlet.java:82)
>>> 
>>>> at
>>> 
>>>> 
>>> 
>>> 
>>> org.apache.flink.client.web.WebInterfaceServer.<init>(WebInterfaceServer.java:158)
>>> 
>>>> at org.apache.flink.client.WebFrontend.main(WebFrontend.java:74)
>>> 
>>>> 
>>> 
>>>> 
>>> 
>>>>> On Feb 23, 2015, at 11:46 PM, Robert Metzger <rmetzger@apache.org>
>>> 
>>>> wrote:
>>> 
>>>>> 
>>> 
>>>>> Hi,
>>> 
>>>>> you said in the other email thread that the error only occurs for
>>> 
>>>>> Wordcount, not for Kmeans.
>>> 
>>>>> Can you copy me the commands for both examples?
>>> 
>>>>> I can not really believe that there is a difference between the two
>>> 
>>> jobs.
>>> 
>>>>> 
>>> 
>>>>> Can you also send us the contents of the jobmanager log file?
>>> 
>>>>> 
>>> 
>>>>> Best,
>>> 
>>>>> Robert
>>> 
>>>>> 
>>> 
>>>>> 
>>> 
>>>>> On Mon, Feb 23, 2015 at 6:04 PM, Dulaj Viduranga <vidura.me@icloud.com
>>> 
>>> 
>>>> 
>>> 
>>>>> wrote:
>>> 
>>>>> 
>>> 
>>>>>> I’m getting "Could not build up connection to JobManager.” When
i
>>> 
>>> tried
>>> 
>>>> to
>>> 
>>>>>> run the wordCount example. Can anyone help?
>>> 
>>>>>> 
>>> 
>>>>>> Dulaj
>>> 
>>>> 
>>> 
>>>> 
>>> 
>>> 
> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message