mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ankur Chauhan" <an...@malloc64.com>
Subject Review Request 27483: Fetcher uses hadoop to fetch URIs regardless of the url scheme.
Date Sun, 02 Nov 2014 03:47:51 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27483/
-----------------------------------------------------------

Review request for mesos.


Summary (updated)
-----------------

Fetcher uses hadoop to fetch URIs regardless of the url scheme.


Repository: mesos-git


Description (updated)
-------

Previously, the fetcher used a hardcoded list of schemes to determine what URIs could be fetched
by hadoop (if available). This is now changed such that we first check if hadoop can fetch
them for us and then we fallback to the os::net and then a local copy method (same as it used
to be). This allows users to fetch artifacts from arbitrary filesystems as long as hadoop
is correctly configured (in core-site.xml).


Diffs
-----


Diff: https://reviews.apache.org/r/27483/diff/


Testing (updated)
-------

make check
sudo bin/mesos-tests.sh --verbose
support/mesos-style.py


Thanks,

Ankur Chauhan


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message