From dev-return-7564-archive-asf-public=cust-asf.ponee.io@airflow.apache.org Sun Feb 3 17:27:26 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 9290F180626 for ; Sun, 3 Feb 2019 18:27:25 +0100 (CET) Received: (qmail 71148 invoked by uid 500); 3 Feb 2019 17:27:24 -0000 Mailing-List: contact dev-help@airflow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.apache.org Delivered-To: mailing list dev@airflow.apache.org Received: (qmail 71126 invoked by uid 99); 3 Feb 2019 17:27:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Feb 2019 17:27:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 560DEC16B1 for ; Sun, 3 Feb 2019 17:27:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.778 X-Spam-Level: * X-Spam-Status: No, score=1.778 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id HCuMxVnw5Ddn for ; Sun, 3 Feb 2019 17:27:21 +0000 (UTC) Received: from mail-yw1-f67.google.com (mail-yw1-f67.google.com [209.85.161.67]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id BBC8C62200 for ; Sun, 3 Feb 2019 17:27:20 +0000 (UTC) Received: by mail-yw1-f67.google.com with SMTP id u200so315244ywu.10 for ; Sun, 03 Feb 2019 09:27:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=TbVuAYkUZIw3TE2UTvwdj7d7+0T/Zva4KKYPu/L+vgI=; b=QRDQmtCtpNgG2BNkqnuj1sF9u9FiT0B42flaiLJRN4Y+CM/HjI8kOei4BTjaCPRAHq L0M2OxwAfw0qawFqbBpK91do/UNCLzMy/RAlhfkEktWulh2hA2RoS4CmCvhwuDxoY92I hjrawRbxh2rBe3gKew88c512FWMGhKY/Q7D2y9qcVEzTcP2/AvPHeeW/k30iitcNQAlH HluTVvDuXrCTZu5MT8yfpN9bi0M6XkxVBng1rJ5v0KtTarH72PpjDZ3tfsTJJsGS5Kb9 S04ZOuLnjXrFnygM+mKUrntooZN3Z30Pl/P08JEQXYtjjAUwhvM5G46sfudRBqgTPfhy 2mGw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=TbVuAYkUZIw3TE2UTvwdj7d7+0T/Zva4KKYPu/L+vgI=; b=EYHBTa31xTQwGF5gs+/EsebhdMzl08XoxSBR7fLWrKp8ciaROjT3xKC30KCfwa+8DW 6AqAZWKYzGRCiIfKzweStsbrzGMaVK/nresQCe28Is6Cg+KeFjGnWO3JUI8097CbYe5M Wyy5SEk22RXC6U/20tkK++W//EXkvN5UIjL+94A1lfkyv4fkyQkfNodJMf8rMKuRtlo1 Mae0RFQoyOARvmRCOFcfds8VgNya3L1/rU0YHxTz2pNR0+MCQistUOF7tDUg1UWUW053 kE9EFf+7fQ/tWwni/+Q3eUA4IrEZg1XVYlvtm2CIXMszqJ/7qh3sxJHRznHVaaun1FVX L5Lg== X-Gm-Message-State: AJcUukcPhvSRJiNPLU4dup4h2zO61ZX48oR+QoiL8grA3WioDPtrILcp HCNIwTsnc4m2FPhRuCbnL9Pc+a2owtzSLZ5TCYY= X-Google-Smtp-Source: ALg8bN7jUNYt0PdAGIQHuEZUw9biC3w+SZDRdd5WYQEBi1v1oaW79tgkU+qj7+ZMkwSyXx9g52notY5H3k2J25vOo5o= X-Received: by 2002:a81:4501:: with SMTP id s1mr45670272ywa.41.1549214839352; Sun, 03 Feb 2019 09:27:19 -0800 (PST) MIME-Version: 1.0 References: <4b9c6968-9668-b5c3-151f-d15de00c4ef3@stefan-seelmann.de> <06834781-7DBC-438E-AE22-1BEF1B1343B9@apache.org> In-Reply-To: <06834781-7DBC-438E-AE22-1BEF1B1343B9@apache.org> From: David Cavaletto Date: Sun, 3 Feb 2019 11:26:53 -0600 Message-ID: Subject: Re: docker-compose testing fails with permission error To: Ash Berlin-Taylor Cc: dev@airflow.apache.org Content-Type: multipart/alternative; boundary="0000000000002e33dc058100b043" --0000000000002e33dc058100b043 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Accidentally replied directly to Ash, not to dev mailing list. Same issue. It does install with sudo, but I know you're not supposed to use sudo with pip. That seemed to let me run the test command, but I had to run it with sudo too. So one interesting note, it works on the Apache Airflow repo I have cloned, but not on my branch (which also on master and up to date with Apache Airflow repo). I'll dig in to see if there is something different. On Sun, Feb 3, 2019 at 11:06 AM Ash Berlin-Taylor wrote: > Try `pip install --user -e .` > > Instructions may need updating? > > On 3 February 2019 16:58:39 GMT, David Cavaletto > wrote: >> >> My id on both my host and docker image is 1000. >> >> On Sat, Feb 2, 2019 at 4:33 PM Stefan Seelmann >> wrote: >> >> What is your user ID (id -u)? I assume that happens when your user ID o= n >>> the host is not 1000, then the mounted /app volume is not writeable by >>> the airflow user within the container which UID is 1000. >>> >>> On 2/2/19 10:04 PM, David Cavaletto wrote: >>> >>>> I'm following the instructions for testing using docker-compose. Afte= r >>>> running `docker-compose -f scripts/ci/docker-compose.yml run >>>> airflow-testing bash` I land on the container as expected. >>>> >>>> But then running `pip install -e .[devel]` fails with a permission er= ror. >>>> Upgrading pip also fails with a permission error. >>>> >>>> Am I missing something? Shouldn't this work out of the box? Any >>>> >>> suggestions? >>> >>>> >>>> >>>> Below is the complete output. >>>> >>>> =E2=9E=9C caddac.airflow git:(master) docker-compose -f >>>> scripts/ci/docker-compose.yml run airflow-testing bash >>>> Starting ci_postgres_1 ... done >>>> Starting ci_mongo_1 ... >>>> Starting ci_rabbitmq_1 ... done >>>> Starting ci_cassandra_1 ... done >>>> Starting ci_mysql_1 ... done >>>> Starting ci_krb5-kdc-server_1 ... done >>>> Starting ci_mongo_1 ... done >>>> airflow@415da8f8db0e:/app$ pip install -e .[devel] >>>> Obtaining file:///app >>>> Complete output from command python setup.py egg_info: >>>> gitpython not found: Cannot compute the git version. >>>> Traceback (most recent call last): >>>> File >>>> >>>> "/usr/local/lib/python3.5/dist-packages/setuptools/command/easy_instal= l.py", >>> >>>> line 466, in check_site_dir >>>> open(testfile, 'w').close() >>>> PermissionError: [Errno 13] Permission denied: >>>> './.eggs/test-easy-install-24.write-test' >>>> >>>> During handling of the above exception, another exception occurre= d: >>>> >>>> Traceback (most recent call last): >>>> File "", line 1, in >>>> File "/app/setup.py", line 417, in >>>> do_setup() >>>> File "/app/setup.py", line 412, in do_setup >>>> python_requires=3D'>=3D2.7,!=3D3.0.*,!=3D3.1.*,!=3D3.2.*,!=3D= 3.3.*,!=3D3.4.*', >>>> File >>>> >>> "/usr/local/lib/python3.5/dist-packages/setuptools/__init__.py", >>> >>>> line 139, in setup >>>> _install_setup_requires(attrs) >>>> File >>>> >>> "/usr/local/lib/python3.5/dist-packages/setuptools/__init__.py", >>> >>>> line 134, in _install_setup_requires >>>> dist.fetch_build_eggs(dist.setup_requires) >>>> File "/usr/local/lib/python3.5/dist-packages/setuptools/dist.py= ", >>>> line 514, in fetch_build_eggs >>>> replace_conflicting=3DTrue, >>>> File >>>> "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", l= ine >>>> 777, in resolve >>>> replace_conflicting=3Dreplace_conflicting >>>> File >>>> "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", l= ine >>>> 1060, in best_match >>>> return self.obtain(req, installer) >>>> File >>>> "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", l= ine >>>> 1072, in obtain >>>> return installer(requirement) >>>> File "/usr/local/lib/python3.5/dist-packages/setuptools/dist.py= ", >>>> line 580, in fetch_build_egg >>>> cmd.ensure_finalized() >>>> File "/usr/lib/python3.5/distutils/cmd.py", line 107, in >>>> ensure_finalized >>>> self.finalize_options() >>>> File >>>> >>>> "/usr/local/lib/python3.5/dist-packages/setuptools/command/easy_instal= l.py", >>> >>>> line 324, in finalize_options >>>> self.check_site_dir() >>>> File >>>> >>>> "/usr/local/lib/python3.5/dist-packages/setuptools/command/easy_instal= l.py", >>> >>>> line 469, in check_site_dir >>>> self.cant_write_to_target() >>>> File >>>> >>>> "/usr/local/lib/python3.5/dist-packages/setuptools/command/easy_instal= l.py", >>> >>>> line 532, in cant_write_to_target >>>> raise DistutilsError(msg) >>>> distutils.errors.DistutilsError: can't create or remove files in >>>> install directory >>>> >>>> The following error occurred while trying to add or remove files = in >>>> >>> the >>> >>>> installation directory: >>>> >>>> [Errno 13] Permission denied: >>>> './.eggs/test-easy-install-24.write-test' >>>> >>>> The installation directory you specified (via --install-dir, >>>> >>> --prefix, >>> >>>> or >>>> the distutils default setting) was: >>>> >>>> ./.eggs >>>> >>>> Perhaps your account does not have write access to this directory= ? >>>> >>> If >>> >>>> the >>>> installation directory is a system-owned directory, you may need t= o >>>> sign in >>>> as the administrator or "root" account. If you do not have >>>> administrative >>>> access to this machine, you may wish to choose a different >>>> >>> installation >>> >>>> directory, preferably one that is listed in your PYTHONPATH >>>> >>> environment >>> >>>> variable. >>>> >>>> For information on other options, you may wish to consult the >>>> documentation at: >>>> >>>> https://setuptools.readthedocs.io/en/latest/easy_install.html >>>> >>>> Please make the appropriate changes for your system and try again= . >>>> ------------------------------ >>>> Command "python setup.py egg_info" failed with error code 1 in /app/ >>>> You are using pip version 18.0, however version 19.0.1 is available. >>>> You should consider upgrading via the 'pip install --upgrade pip' >>>> >>> command. >>> >>>> airflow@415da8f8db0e:/app$ pip install --upgrade pip >>>> Collecting pip >>>> Using cached >>>> >>>> https://files.pythonhosted.org/packages/46/dc/7fd5df840efb3e56c8b4f768= 793a237ec4ee59891959d6a215d63f727023/pip-19.0.1-py2.py3-none-any.whl >>> >>>> Installing collected packages: pip >>>> Found existing installation: pip 18.0 >>>> Uninstalling pip-18.0: >>>> Could not install packages due to an EnvironmentError: [Errno 13] >>>> Permission denied: '/usr/bin/pip' >>>> Consider using the `--user` option or check the permissions. >>>> >>>> You are using pip version 18.0, however version 19.0.1 is available. >>>> You should consider upgrading via the 'pip install --upgrade pip' >>>> >>> command. >>> >>>> airflow@415da8f8db0e:/app$ >>>> >>>> >>> >>> --0000000000002e33dc058100b043--