flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepak Jha <dkjhan...@gmail.com>
Subject Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS
Date Thu, 10 Mar 2016 15:32:29 GMT
Yes. Flink 1.0.0

On Thursday, March 10, 2016, Stephan Ewen <sewen@apache.org> wrote:

> Hi!
>
> Is this Flink 1.0.0 ?
>
> Stephan
>
>
> On Thu, Mar 10, 2016 at 6:02 AM, Deepak Jha <dkjhanitt@gmail.com
> <javascript:;>> wrote:
>
> > Hi All,
> >
> > I'm trying to setup Flink 1.0.0 cluster on Docker (separate containers
> for
> > jobmanager and taskmanager) inside AWS (Using AWS ECS service). I tested
> it
> > locally and its working fine but on AWS Docker, I am running into
> following
> > issue
> >
> > *2016-03-09 18:04:12,114 PST [INFO]  ec2-52-3-248-202.compute-1.ama
> [main]
> > o.a.f.runtime.jobmanager.JobManager - Starting JobManager with
> > high-availability*
> > *2016-03-09 18:04:12,118 PST [INFO]  ec2-52-3-248-202.compute-1.ama
> [main]
> > o.a.f.runtime.jobmanager.JobManager - Starting JobManager on
> > 172.31.63.152:8079 <http://172.31.63.152:8079> with execution mode
> CLUSTER*
> > *2016-03-09 18:04:12,172 PST [INFO]  ec2-52-3-248-202.compute-1.ama
> [main]
> > o.a.f.runtime.jobmanager.JobManager - Security is not enabled. Starting
> > non-authenticated JobManager.*
> > *2016-03-09 18:04:12,174 PST [DEBUG] ec2-52-3-248-202.compute-1.ama
> [main]
> > org.apache.flink.util.NetUtils - Trying to open socket on port 8079*
> > *2016-03-09 18:04:12,176 PST [DEBUG] ec2-52-3-248-202.compute-1.ama
> [main]
> > org.apache.flink.util.NetUtils - Unable to allocate socket on port*
> > *java.net.BindException: Cannot assign requested address*
> > *    at java.net.PlainSocketImpl.socketBind(Native Method)*
> > *    at
> > java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)*
> > *    at java.net.ServerSocket.bind(ServerSocket.java:375)*
> > *    at java.net.ServerSocket.<init>(ServerSocket.java:237)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2$$anon$3.createSocket(JobManager.scala:1722)*
> > *    at
> > org.apache.flink.util.NetUtils.createSocketFromPorts(NetUtils.java:237)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply$mcV$sp(JobManager.scala:1719)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply(JobManager.scala:1717)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply(JobManager.scala:1717)*
> > *    at scala.util.Try$.apply(Try.scala:192)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1772)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1717)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1653)*
> > *    at
> > org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)*
> > *2016-03-09 18:04:12,180 PST [ERROR] ec2-52-3-248-202.compute-1.ama
> [main]
> > o.a.f.runtime.jobmanager.JobManager - Failed to run JobManager.*
> > *java.lang.RuntimeException: Unable to do further retries starting the
> > actor system*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1777)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1717)*
> > *    at
> >
> org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1653)*
> > *    at
> > org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)*
> > *2016-03-09 18:04:12,991 PST [DEBUG] ec2-52-3-248-202.compute-1.ama
> [main]
> > o.a.h.m.lib.MutableMetricsFactory - field
> > org.apache.hadoop.metrics2.lib.MutableRate
> > org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess
> > with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=,
> > sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful
> > kerberos logins and latency (milliseconds)], valueName=Time)*
> >
> >
> > Initially Jobmanager tries to bind to port 0 which did not work. On
> > looking further into it, I tried using recovery jobmanager port using
> > different port combinations, but it does not seems to be working... I've
> > exposed the ports in the docker compose file as well....
> >
> >
> > PFA the jobmanager log file for details also the jobmanager config
> file...
> > --
> > Thanks,
> > Deepak Jha
> >
> >
>


-- 
Sent from Gmail Mobile

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message