Mailing-List: contact issues-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Wed, 25 Jan 2017 06:36:26 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: issues@flink.apache.org
Message-ID: <JIRA.13037589.1485325050000.196566.1485326186505@Atlassian.JIRA>
In-Reply-To: <JIRA.13037589.1485325050000@Atlassian.JIRA>
References: <JIRA.13037589.1485325050000@Atlassian.JIRA> <JIRA.13037589.1485325050386@jira-lw-us.apache.org>
Subject: [jira] [Commented] (FLINK-5635) Improve Docker tooling to make it
 easier to build images and launch Flink via Docker tools
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 25 Jan 2017 06:36:31 -0000


    [ https://issues.apache.org/jira/browse/FLINK-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837269#comment-15837269 ] 

ASF GitHub Bot commented on FLINK-5635:
---------------------------------------

GitHub user jgrier opened a pull request:

    https://github.com/apache/flink/pull/3205

    [FLINK-5635] Improve Docker tooling to make it easier to build images and launch Flink via Docker tools

    Improvements for Docker on Flink experience.
    
    This PR depends on this other one:  https://github.com/apache/flink/pull/3204
    
    - Modifying Dockerfile to allow building from local flink-dist as well as release URLs
    - Making image name configurable so it's easier for user's to use this to build an publish their own images
    - Logging to stdout rather than just files
    - Adding scripts to deploy seamlessly on Docker Swarm without host networking
    - Updating Docker Compose scripts to work correctly for deploying locally
    - Generally parameterizing things so these Docker scripts are more generally useful and self-documenting
    - Provides options so that you can deploy multiple Flink services with unique names on Docker Swarm
    - This should all work well with the new Docker "stack" stuff as well.
    
    Example usage:
    
    ```
    # Build a Docker image from your local flink build
    ./build.sh --from-local-dist --image-name "dataartisans/flink"
    ```
    
    ```
    # Build a Docker image from an official release
    ./build.sh --from-release --flink-verison 1.2.0 --hadoop-version 2.7 --scala-version 2.11 --image-name "dataartisans/flink"
    ```
    ```
    # Run with Docker Compose
    docker-compose up -d
    docker-compose scale taskmanager=4
    ```
    ```
    # Run on Docker Swarm
    ./create-docker-swarm-service.sh --image-name "dataartisans/flink" my-flink-service my-flink-port
    ```
    ```
    # Shut down
    ./remove-docker-swarm-service.sh --image-name "dataartisans/flink" my-flink-service
    ```


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jgrier/flink release-1.2

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/3205.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3205
    
----
commit d380e98b397c770ee4b7eb9e4abb2387e7672d4c
Author: Jamie Grier <jamie.grier@gmail.com>
Date:   2017-01-21T00:12:17Z

    Improvements for Docker on Flink experience.
    
    Modifying Dockerfile to build from local flink-dist as well as release URLs.
    Logging to stdout.
    Adding scripts to deploy seamlessly on Docker Swarm.
    Updating Docker Compose scripts to work correctly.
    Parameterizing things so these Docker scripts are more generally useful.

commit 962290ab66d993cac4c4e233a017feb8a6eb1cc5
Author: Jamie Grier <jamie.grier@gmail.com>
Date:   2017-01-21T00:14:27Z

    Adding flag to flink-daemon.sh and related scripts so that we can actually log to the console -- which is better for Docker environments.

commit 66c2133ede0ed9914baba2fe7b93f1b9d585ede2
Author: Jamie Grier <jamie.grier@gmail.com>
Date:   2017-01-25T05:45:23Z

    Adding Apache license to new files.

----


> Improve Docker tooling to make it easier to build images and launch Flink via Docker tools
> ------------------------------------------------------------------------------------------
>
>                 Key: FLINK-5635
>                 URL: https://issues.apache.org/jira/browse/FLINK-5635
>             Project: Flink
>          Issue Type: Improvement
>          Components: Docker
>    Affects Versions: 1.2.0
>            Reporter: Jamie Grier
>             Fix For: 1.2.0
>
>
> This is a bit of a catch-all ticket for general improvements to the Flink on Docker experience.
> Things to improve:
>   - Make it possible to build a Docker image from your own flink-dist directory as well as official releases.
>   - Make it possible to override the image name so a user can more easily publish these images to their Docker repository
>   - Provide scripts that show how to properly run on Docker Swarm or similar environments with overlay networking (Kubernetes) without using host networking.
>   - Log to stdout rather than to files.
>   - Work properly with docker-compose for local deployment as well as production deployments (Swarm/k8s)


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)