flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Biswajit Das <biswajit...@gmail.com>
Subject Automate Job submission with container
Date Tue, 15 Aug 2017 01:04:03 GMT
Hi There,

A few weeks back I have posted here regarding flink docker container
running on mesos. I'm able to run the same successfully; I'm heading
towards full CI/CD deployment with the marathon, most of our deployment is
automated via the marathon, and sometimes even I trigger metrics based auto
scale from the marathon or another scaling service or move service with AWS
spot instance randomly.
Now how do I trigger the job automatically inside the container once JM &
TM is up . I have tested few option and just wanted to validate with the
group here. I have uber app jar already bundled inside the Docker container
.

Option .
   1. Schedule a one-time cron like task inside the container with flink
run -d and some delay.
2.  Submit via REST, but it complicates the process as I have to find app
DNS from my CI although I have this setup with Bamboo and HAProxy just want
to avoid this complicated process.( given I have many apps running )

I'm sure someone already came across the similar problem, please let me
know if any one has any inputs or suggestion.

~ Biswajit

Mime
View raw message