flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepak Jha <dkjhan...@gmail.com>
Subject Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS
Date Thu, 10 Mar 2016 17:27:49 GMT
Hi Stephan,
I tried 0.10.2 as well still running into the same issue.

On Thursday, March 10, 2016, Deepak Jha <dkjhanitt@gmail.com> wrote:

> Yes. Flink 1.0.0
>
> On Thursday, March 10, 2016, Stephan Ewen <sewen@apache.org
> <javascript:_e(%7B%7D,'cvml','sewen@apache.org');>> wrote:
>
>> Hi!
>>
>> Is this Flink 1.0.0 ?
>>
>> Stephan
>>
>>
>> On Thu, Mar 10, 2016 at 6:02 AM, Deepak Jha <dkjhanitt@gmail.com> wrote:
>>
>> > Hi All,
>> >
>> > I'm trying to setup Flink 1.0.0 cluster on Docker (separate containers
>> for
>> > jobmanager and taskmanager) inside AWS (Using AWS ECS service). I
>> tested it
>> > locally and its working fine but on AWS Docker, I am running into
>> following
>> > issue
>> >
>> > *2016-03-09 18:04:12,114 PST [INFO]  ec2-52-3-248-202.compute-1.ama
>> [main]
>> > o.a.f.runtime.jobmanager.JobManager - Starting JobManager with
>> > high-availability*
>> > *2016-03-09 18:04:12,118 PST [INFO]  ec2-52-3-248-202.compute-1.ama
>> [main]
>> > o.a.f.runtime.jobmanager.JobManager - Starting JobManager on
>> > 172.31.63.152:8079 <http://172.31.63.152:8079> with execution mode
>> CLUSTER*
>> > *2016-03-09 18:04:12,172 PST [INFO]  ec2-52-3-248-202.compute-1.ama
>> [main]
>> > o.a.f.runtime.jobmanager.JobManager - Security is not enabled. Starting
>> > non-authenticated JobManager.*
>> > *2016-03-09 18:04:12,174 PST [DEBUG] ec2-52-3-248-202.compute-1.ama
>> [main]
>> > org.apache.flink.util.NetUtils - Trying to open socket on port 8079*
>> > *2016-03-09 18:04:12,176 PST [DEBUG] ec2-52-3-248-202.compute-1.ama
>> [main]
>> > org.apache.flink.util.NetUtils - Unable to allocate socket on port*
>> > *java.net.BindException: Cannot assign requested address*
>> > *    at java.net.PlainSocketImpl.socketBind(Native Method)*
>> > *    at
>> > java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)*
>> > *    at java.net.ServerSocket.bind(ServerSocket.java:375)*
>> > *    at java.net.ServerSocket.<init>(ServerSocket.java:237)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2$$anon$3.createSocket(JobManager.scala:1722)*
>> > *    at
>> > org.apache.flink.util.NetUtils.createSocketFromPorts(NetUtils.java:237)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply$mcV$sp(JobManager.scala:1719)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply(JobManager.scala:1717)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply(JobManager.scala:1717)*
>> > *    at scala.util.Try$.apply(Try.scala:192)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1772)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1717)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1653)*
>> > *    at
>> > org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)*
>> > *2016-03-09 18:04:12,180 PST [ERROR] ec2-52-3-248-202.compute-1.ama
>> [main]
>> > o.a.f.runtime.jobmanager.JobManager - Failed to run JobManager.*
>> > *java.lang.RuntimeException: Unable to do further retries starting the
>> > actor system*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1777)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1717)*
>> > *    at
>> >
>> org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1653)*
>> > *    at
>> > org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)*
>> > *2016-03-09 18:04:12,991 PST [DEBUG] ec2-52-3-248-202.compute-1.ama
>> [main]
>> > o.a.h.m.lib.MutableMetricsFactory - field
>> > org.apache.hadoop.metrics2.lib.MutableRate
>> > org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess
>> > with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=,
>> > sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful
>> > kerberos logins and latency (milliseconds)], valueName=Time)*
>> >
>> >
>> > Initially Jobmanager tries to bind to port 0 which did not work. On
>> > looking further into it, I tried using recovery jobmanager port using
>> > different port combinations, but it does not seems to be working... I've
>> > exposed the ports in the docker compose file as well....
>> >
>> >
>> > PFA the jobmanager log file for details also the jobmanager config
>> file...
>> > --
>> > Thanks,
>> > Deepak Jha
>> >
>> >
>>
>
>
> --
> Sent from Gmail Mobile
>


-- 
Sent from Gmail Mobile

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message