From commits-return-18645-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Mon Aug 20 13:37:23 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 62FB718067C for ; Mon, 20 Aug 2018 13:37:23 +0200 (CEST) Received: (qmail 61649 invoked by uid 500); 20 Aug 2018 11:37:22 -0000 Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list commits@airflow.incubator.apache.org Received: (qmail 61638 invoked by uid 99); 20 Aug 2018 11:37:22 -0000 Received: from ec2-52-202-80-70.compute-1.amazonaws.com (HELO gitbox.apache.org) (52.202.80.70) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Aug 2018 11:37:22 +0000 From: GitBox To: commits@airflow.apache.org Subject: [GitHub] gerardo commented on a change in pull request #3393: [AIRFLOW-2499] Dockerised CI pipeline Message-ID: <153476504192.4927.14107951276616063936.gitbox@gitbox.apache.org> Date: Mon, 20 Aug 2018 11:37:21 -0000 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit gerardo commented on a change in pull request #3393: [AIRFLOW-2499] Dockerised CI pipeline URL: https://github.com/apache/incubator-airflow/pull/3393#discussion_r211230394 ########## File path: .travis.yml ########## @@ -19,94 +19,40 @@ sudo: true dist: trusty language: python -jdk: - - oraclejdk8 -services: - - cassandra - - mongodb - - mysql - - postgresql - - rabbitmq -addons: - apt: - packages: - - slapd - - ldap-utils - - openssh-server - - mysql-server-5.6 - - mysql-client-core-5.6 - - mysql-client-5.6 - - krb5-user - - krb5-kdc - - krb5-admin-server - - oracle-java8-installer - postgresql: "9.2" -python: - - "2.7" - - "3.5" env: global: + - DOCKER_COMPOSE_VERSION=1.20.0 - SLUGIFY_USES_TEXT_UNIDECODE=yes - TRAVIS_CACHE=$HOME/.travis_cache/ - - KRB5_CONFIG=/etc/krb5.conf - - KRB5_KTNAME=/etc/airflow.keytab - # Travis on google cloud engine has a global /etc/boto.cfg that - # does not work with python 3 - - BOTO_CONFIG=/tmp/bogusvalue matrix: + - TOX_ENV=flake8 - TOX_ENV=py27-backend_mysql - TOX_ENV=py27-backend_sqlite - TOX_ENV=py27-backend_postgres - - TOX_ENV=py35-backend_mysql - - TOX_ENV=py35-backend_sqlite - - TOX_ENV=py35-backend_postgres - - TOX_ENV=flake8 + - TOX_ENV=py35-backend_mysql PYTHON_VERSION=3 + - TOX_ENV=py35-backend_sqlite PYTHON_VERSION=3 + - TOX_ENV=py35-backend_postgres PYTHON_VERSION=3 - TOX_ENV=py27-backend_postgres KUBERNETES_VERSION=v1.9.0 - - TOX_ENV=py35-backend_postgres KUBERNETES_VERSION=v1.10.0 -matrix: - exclude: - - python: "3.5" - env: TOX_ENV=py27-backend_mysql - - python: "3.5" - env: TOX_ENV=py27-backend_sqlite - - python: "3.5" - env: TOX_ENV=py27-backend_postgres - - python: "2.7" - env: TOX_ENV=py35-backend_mysql - - python: "2.7" - env: TOX_ENV=py35-backend_sqlite - - python: "2.7" - env: TOX_ENV=py35-backend_postgres - - python: "2.7" - env: TOX_ENV=flake8 - - python: "3.5" - env: TOX_ENV=py27-backend_postgres KUBERNETES_VERSION=v1.9.0 - - python: "2.7" - env: TOX_ENV=py35-backend_postgres KUBERNETES_VERSION=v1.10.0 + - TOX_ENV=py35-backend_postgres KUBERNETES_VERSION=v1.10.0 PYTHON_VERSION=3 cache: directories: - $HOME/.wheelhouse/ + - $HOME/.cache/pip - $HOME/.travis_cache/ before_install: - - yes | ssh-keygen -t rsa -C your_email@youremail.com -P '' -f ~/.ssh/id_rsa - - cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys - - ln -s ~/.ssh/authorized_keys ~/.ssh/authorized_keys2 - - chmod 600 ~/.ssh/* - - jdk_switcher use oraclejdk8 + - sudo ls -lh $HOME/.cache/pip/ + - sudo rm -rf $HOME/.cache/pip/* $HOME/.wheelhouse/* + - sudo chown -R travis.travis $HOME/.cache/pip install: + # Use recent docker-compose version + - sudo rm /usr/local/bin/docker-compose Review comment: @Fokko Ah yeah, docker-compose. There's a reason for this. In earlier versions of this PR, the build logs were massive, because, by default, docker-compose shows ascii progress bars when downloading docker images. These progress bars don't render properly in TravisCI (it becomes like 100 lines per progress bar). The only way to disable this is to [set the docker-compose log-level to `ERROR`](https://github.com/apache/incubator-airflow/pull/3393/files#diff-354f30a63fb0907d4ad57269548329e3R55). This change was only added in docker-compose [1.20.0](https://github.com/docker/compose/blob/master/CHANGELOG.md#all-formats-1). The TravisCI version is very old (1.4 if I remember correctly). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org With regards, Apache Git Services