mesos-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Tongen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MESOS-4450) Fetcher incorrectly prepends forward slash to google cloud storage uri
Date Thu, 21 Jan 2016 17:59:40 GMT
Andrew Tongen created MESOS-4450:
------------------------------------

             Summary: Fetcher incorrectly prepends forward slash to google cloud storage uri
                 Key: MESOS-4450
                 URL: https://issues.apache.org/jira/browse/MESOS-4450
             Project: Mesos
          Issue Type: Bug
          Components: fetcher
    Affects Versions: 0.26.0
            Reporter: Andrew Tongen


Log of failure:

{quote}
I0121 17:08:50.458729   421 fetcher.cpp:185] Fetching URI 'gs://bucket/spark-1.5.2-bin-hadoop2.6.tgz'
I0121 17:08:50.700636   421 fetcher.cpp:110] Downloading resource with Hadoop client from
'gs://bucket/spark-1.5.2-bin-hadoop2.6' to '/var/lib/mesos-slave/slaves/ca28da71-850d-4134-a390-2f007a032ade-S0/frameworks/d38cf30b-f037-487c-bd50-191819a570ea-0000/executors/3/runs/6190780d-e5d5-465a-b463-4e5002bf3de6/spark-1.5.2-bin-hadoop2.6.tgz'
-copyToLocal: java.net.URISyntaxException: Expected scheme-specific part at index 3: gs:
Usage: hadoop fs [generic options] -copyToLocal [-p] [-ignoreCrc] [-crc] <src> ... <localdst>
E0121 17:08:51.544994   421 shell.hpp:90] Command '/opt/hadoop/bin/hadoop fs -copyToLocal
'/gs://bucket/spark-1.5.2-bin-hadoop2.6.tgz' '/var/lib/mesos-slave/slaves/ca28da71-850d-4134-a390-2f007a032ade-S0/frameworks/d38cf30b-f037-487c-bd50-191819a570ea-0000/executors/3/runs/6190780d-e5d5-465a-b463-4e5002bf3de6/spark-1.5.2-bin-hadoop2.6.tgz''
failed; this is the output:
Failed to fetch 'gs://bucket/spark-1.5.2-bin-hadoop2.6.tgz': HDFS copyToLocal failed: Failed
to execute '/opt/hadoop/bin/hadoop fs -copyToLocal '/gs://bucket/spark-1.5.2-bin-hadoop2.6.tgz'
'/var/lib/mesos-slave/slaves/ca28da71-850d-4134-a390-2f007a032ade-S0/frameworks/d38cf30b-f037-487c-bd50-191819a570ea-0000/executors/3/runs/6190780d-e5d5-465a-b463-4e5002bf3de6/spark-1.5.2-bin-hadoop2.6.tgz'';
the command was either not found or exited with a non-zero exit status: 255
Failed to synchronize with slave (it's probably exited)
{quote}

You can see in 

https://github.com/apache/mesos/blob/master/src/launcher/fetcher.cpp#L100

that sourceUri is logged correctly, but then has a forward slash prepended in the error message
after

https://github.com/apache/mesos/blob/master/src/launcher/fetcher.cpp#L112



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message