aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Stein <joe.st...@stealth.ly>
Subject Re: executor build issue
Date Thu, 16 Oct 2014 16:49:53 GMT
hmmm, I did that but getting same error... should I do it for the 0.20.0
egg? I downloaded and easy_install the 0.20.1 egg (because that is Mesos
version I am running). Or can I change something in Aurora so it uses
0.20.1 egg I just installed?

/*******************************************
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/

On Thu, Oct 16, 2014 at 12:38 PM, Bill Farner <wfarner@apache.org> wrote:

> The relevant bit from our vagrant provisioning script is here:
>
>
> https://github.com/apache/incubator-aurora/blob/599a7dcbe11a49f15d082882781e812a092e959d/examples/vagrant/provision-dev-cluster.sh#L37-L42
>
> Unfortunately, the mesos RPM/debs don't include python libraries, so we
> need to install those out of band :-/
>
>
> -=Bill
>
> On Thu, Oct 16, 2014 at 9:31 AM, Zameer Manji <zmanji@twopensource.com>
> wrote:
>
> > You need to grab and use the eggs listed here
> > https://mesosphere.com/downloads/
> >
> > On Thu, Oct 16, 2014 at 9:20 AM, Joe Stein <joe.stein@stealth.ly> wrote:
> >
> > > I am getting the following error trying to build executor. I have mesos
> > > 0.20.1 (below seems like it is looking for 0.20.0 maybe that is problem
> > not
> > > sure if so and how to fix???)
> > >
> > > /opt/apache/incubator-aurora$aurorabuild executor
> > > Build operating on top level addresses:
> > >
> > >
> >
> set([BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > gc_executor)])
> > > Building PythonBinary
> > >
> > >
> >
> PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > gc_executor)):
> > > Problem executing PythonBuilder for targets
> > >
> > >
> >
> OrderedSet([PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > gc_executor)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > path)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > executor_detector)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > executor_vars)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > gc_executor)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > executor_base)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > ckpt)),
> > >
> > >
> >
> PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/thermos/BUILD,
> > > py-thrift)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > helper)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > inspector)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > muxer)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/monitoring/BUILD,
> > > detector)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/monitoring/BUILD,
> > > garbage)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/BUILD,
> > > schema)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/schema/BUILD,
> > > schema)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/config/BUILD,
> > > schema)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > planner)),
> > >
> > >
> >
> PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD,
> > > py-thrift)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > sandbox))]): Traceback (most recent call last):
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/commands/build.py",
> > > line 130, in _python_build
> > >     debug=self._verbose)
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_builder.py",
> > > line 52, in build
> > >     conn_timeout=conn_timeout).run()
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/binary_builder.py",
> > > line 53, in run
> > >     env = self.chroot.dump()
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_chroot.py",
> > > line 191, in dump
> > >     conn_timeout=self._conn_timeout)
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/resolver.py",
> > > line 100, in resolve_multi
> > >     platform=platform)
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pex-0.7.0-py2.py3-none-any.whl.1528dd6e325a4178651c50d45cba558709e6df75/pex-0.7.0-py2.py3-none-any.whl/pex/resolver.py",
> > > line 101, in resolve
> > >     raise Unsatisfiable('Cannot satisfy requirements: %s' %
> > > requirement_set[requirement.key])
> > > Unsatisfiable: Cannot satisfy requirements:
> > > [PythonRequirement(mesos.native==0.20.0)]
> > >
> > >
> > > Usage:
> > >   pantsbuild.pants-0.0.24.pex build (options) [spec] (build args)
> > >   pantsbuild.pants-0.0.24.pex build (options) [spec]... -- (build args)
> > >
> > > Options:
> > >   --version             show program's version number and exit
> > >   --no-pantsrc          Specifies that pantsrc files should be ignored.
> > >   --log-exit            Log an exit message on success or failure.
> > >   -t CONN_TIMEOUT, --timeout=CONN_TIMEOUT
> > >                         Number of seconds to wait for http connections.
> > >   -i INTERPRETERS, --interpreter=INTERPRETERS
> > >                         Constrain what Python interpreters to use.
> Uses
> > >                         Requirement format from pkg_resources, e.g.
> > >                         'CPython>=2.6,<3' or 'PyPy'. By default, no
> > >                         constraints are used.  Multiple constraints may
> > be
> > >                         added.  They will be ORed together.
> > >   -v, --verbose         Show verbose output.
> > >   -f, --fast            Run tests in a single chroot.
> > >
> > > Builds the specified Python target(s). Use ./pants goal for JVM and
> other
> > > targets.
> > > Build operating on top level addresses:
> > >
> > >
> >
> set([BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > thermos_executor)])
> > > Building PythonBinary
> > >
> > >
> >
> PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > thermos_executor)):
> > > Problem executing PythonBuilder for targets
> > >
> > >
> >
> OrderedSet([PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > thermos_executor)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > announcer)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > status_checker)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > task_info)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/BUILD,
> > > config)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > common)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > aurora_job_key)),
> > >
> > >
> >
> PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD,
> > > py-thrift)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > cluster)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > cluster_option)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > clusters)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > http_signaler)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > shellify)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD,
> > > transport)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/auth/BUILD,
> > > auth)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD,
> > > py-thrift-packaged)),
> > >
> > >
> >
> PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD,
> > > py-thrift-test)),
> > >
> > >
> >
> PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD,
> > > py-thrift-storage)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/schema/BUILD,
> > > schema)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/config/BUILD,
> > > schema)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > planner)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > executor_timeout)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > health_checker)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > sandbox)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > executor_detector)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > executor_vars)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > aurora_executor)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > status_manager)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > executor_base)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > kill_manager)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD,
> > > task_runner)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > thermos_task_runner)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > common)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > ckpt)),
> > >
> > >
> >
> PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/thermos/BUILD,
> > > py-thrift)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > options)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD,
> > > path)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > core)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > inspector)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > muxer)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > runner)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > helper)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD,
> > > process)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/config/BUILD,
> > > config)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/monitoring/BUILD,
> > > monitor)),
> > >
> > >
> >
> PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD,
> > > thermos_statuses))]): Traceback (most recent call last):
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/commands/build.py",
> > > line 130, in _python_build
> > >     debug=self._verbose)
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_builder.py",
> > > line 52, in build
> > >     conn_timeout=conn_timeout).run()
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/binary_builder.py",
> > > line 53, in run
> > >     env = self.chroot.dump()
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_chroot.py",
> > > line 191, in dump
> > >     conn_timeout=self._conn_timeout)
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/resolver.py",
> > > line 100, in resolve_multi
> > >     platform=platform)
> > >   File
> > >
> > >
> >
> "/root/.pex/install/pex-0.7.0-py2.py3-none-any.whl.1528dd6e325a4178651c50d45cba558709e6df75/pex-0.7.0-py2.py3-none-any.whl/pex/resolver.py",
> > > line 101, in resolve
> > >     raise Unsatisfiable('Cannot satisfy requirements: %s' %
> > > requirement_set[requirement.key])
> > > Unsatisfiable: Cannot satisfy requirements:
> > > [PythonRequirement(mesos.native==0.20.0)]
> > >
> > >
> > > Usage:
> > >   pantsbuild.pants-0.0.24.pex build (options) [spec] (build args)
> > >   pantsbuild.pants-0.0.24.pex build (options) [spec]... -- (build args)
> > >
> > > Options:
> > >   --version             show program's version number and exit
> > >   --no-pantsrc          Specifies that pantsrc files should be ignored.
> > >   --log-exit            Log an exit message on success or failure.
> > >   -t CONN_TIMEOUT, --timeout=CONN_TIMEOUT
> > >                         Number of seconds to wait for http connections.
> > >   -i INTERPRETERS, --interpreter=INTERPRETERS
> > >                         Constrain what Python interpreters to use.
> Uses
> > >                         Requirement format from pkg_resources, e.g.
> > >                         'CPython>=2.6,<3' or 'PyPy'. By default, no
> > >                         constraints are used.  Multiple constraints may
> > be
> > >                         added.  They will be ORed together.
> > >   -v, --verbose         Show verbose output.
> > >   -f, --fast            Run tests in a single chroot.
> > >
> > > Builds the specified Python target(s). Use ./pants goal for JVM and
> other
> > > targets.
> > > Build operating on top level addresses:
> > >
> > >
> >
> set([BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > thermos_runner)])
> > > Building PythonBinary
> > >
> > >
> >
> PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD,
> > > thermos_runner)):
> > > Wrote /mnt/data1/apache/incubator-aurora/dist/thermos_runner.pex
> > > <stdin>:4: UserWarning: Duplicate name:
> > > 'apache/aurora/executor/resources/__init__.py'
> > > <stdin>:5: UserWarning: Duplicate name:
> > > 'apache/aurora/executor/resources/thermos_runner.pex'
> > >
> > > /*******************************************
> > >  Joe Stein
> > >  Founder, Principal Consultant
> > >  Big Data Open Source Security LLC
> > >  http://www.stealth.ly
> > >  Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > ********************************************/
> > >
> >
> >
> >
> > --
> > Zameer Manji
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message