beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmet Altay (JIRA)" <>
Subject [jira] [Created] (BEAM-2587) Build fails due to python sdk
Date Tue, 11 Jul 2017 19:11:00 GMT
Ahmet Altay created BEAM-2587:

             Summary: Build fails due to python sdk
                 Key: BEAM-2587
             Project: Beam
          Issue Type: Bug
          Components: sdk-py
    Affects Versions: 2.1.0
            Reporter: Ahmet Altay

Build fails with the following errors when {{mvn clean package}} is used on a clean Ubuntu
16.04 LTS machine with pip 8.x. The issue is resolved when pip is upgraded to pip 9.x

"RuntimeError: Not in apache git tree; unable to find proto definitions."
"DistutilsOptionError: can't combine user with prefix, exec_prefix/home, or install_(plat)base‚Äč"

We need to understand the issue and maybe add a note about requiring pip 9.x for development.
Note that this does not affect end users using prepackaged artifacts from central repositories.

cc: [~robertwb]

Script for reproduction:


set -e

readonly MACHINE_ID=$(hexdump -n 1 -e '"%x"' /dev/random)
readonly MACHINE="${USER}-beam-build-${MACHINE_ID}"
readonly ZONE="us-central1-c"

# provision building machine
echo "Provisioning Build Machine (Ubuntu 16.04 LTS)"
gcloud compute instances create "$MACHINE" \
  --zone="$ZONE" \
  --image-project="ubuntu-os-cloud" \

# wait for ssh to be ready
echo "Waiting for machine to finish booting"
sleep 30

# ssh into the machine
# 1. install dependencies as specified by beam readme
# 2. download beam source from github
# 3. build with maven
echo "Downloading and building Apache Beam (release-2.1.0)"
gcloud compute ssh "$MACHINE" --zone="$ZONE" << EOF
sudo apt-get --assume-yes update
sudo apt-get --assume-yes install \
    openjdk-8-jdk \
    maven \
    python-setuptools \
tar -xzf release-2.1.0.tar.gz
cd beam-release-2.1.0
mvn clean package

This message was sent by Atlassian JIRA

View raw message