hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Grandl <rgra...@student.ethz.ch>
Subject Compile Scheduler from source code
Date Fri, 14 Jan 2011 14:18:03 GMT
Hi all,

I was trying to compile FairScheduler from source code.

I went to: ~/hadoop-0.21.0/mapred/src/contrib/fairscheduler and run: ant 
clean compile

However, I get the following errors:

-------------------------------------------------------------------------------------------------------------------------------------------
  Buildfile: build.xml

clean:
      [echo] contrib: fairscheduler
    [delete] Deleting directory 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler

check-contrib:

init:
      [echo] contrib: fairscheduler
     [mkdir] Created dir: 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler
     [mkdir] Created dir: 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler/classes
     [mkdir] Created dir: 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler/test
     [mkdir] Created dir: 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler/test/extraconf
     [mkdir] Created dir: 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler/examples
     [mkdir] Created dir: 
/home/rgrandl/hadoop-0.21.0/mapred/build/contrib/fairscheduler/test/logs

init-contrib:

ivy-download:
       [get] Getting: 
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar
       [get] To: /home/rgrandl/hadoop-0.21.0/mapred/ivy/ivy-2.1.0.jar
       [get] Not modified - so not downloaded

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.1.0 - 20090925235825 :: 
http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = 
/home/rgrandl/hadoop-0.21.0/mapred/ivy/ivysettings.xml

ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: 
org.apache.hadoop#fairscheduler;working@grandl
[ivy:resolve]     confs: [common]
[ivy:resolve]     found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve]     found log4j#log4j;1.2.15 in maven2
[ivy:resolve]     found org.mortbay.jetty#servlet-api-2.5;6.1.14 in maven2
[ivy:resolve]     found junit#junit;4.8.1 in maven2
[ivy:resolve]     found org.apache.hadoop#avro;1.3.2 in maven2
[ivy:resolve]     found org.codehaus.jackson#jackson-mapper-asl;1.4.2 in 
maven2
[ivy:resolve]     found org.codehaus.jackson#jackson-core-asl;1.4.2 in 
maven2
[ivy:resolve]     found org.slf4j#slf4j-api;1.5.11 in maven2
[ivy:resolve]     found com.thoughtworks.paranamer#paranamer;2.2 in maven2
[ivy:resolve]     found com.thoughtworks.paranamer#paranamer-ant;2.2 in 
maven2
[ivy:resolve]     found 
com.thoughtworks.paranamer#paranamer-generator;2.2 in maven2
[ivy:resolve]     found com.thoughtworks.qdox#qdox;1.10.1 in maven2
[ivy:resolve]     found asm#asm;3.2 in maven2
[ivy:resolve]     found commons-lang#commons-lang;2.5 in maven2
[ivy:resolve]     found org.mortbay.jetty#jetty-util;6.1.14 in maven2
[ivy:resolve]     found org.mortbay.jetty#jetty;6.1.14 in maven2
[ivy:resolve]     found org.mortbay.jetty#jsp-api-2.1;6.1.14 in maven2
[ivy:resolve]     found org.mortbay.jetty#jsp-2.1;6.1.14 in maven2
[ivy:resolve] :: resolution report :: resolve 5315ms :: artifacts dl 36ms
[ivy:resolve]     :: evicted modules:
[ivy:resolve]     
org.codehaus.jackson#jackson-mapper-asl;${jackson.version} by 
[org.codehaus.jackson#jackson-mapper-asl;1.4.2] in [common]
[ivy:resolve]     
com.thoughtworks.paranamer#paranamer;${paranamer.version} by 
[com.thoughtworks.paranamer#paranamer;2.2] in [common]
[ivy:resolve]     
com.thoughtworks.paranamer#paranamer-ant;${paranamer.version} by 
[com.thoughtworks.paranamer#paranamer-ant;2.2] in [common]
     ---------------------------------------------------------------------
     |                  |            modules            ||   artifacts   |
     |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
     ---------------------------------------------------------------------
     |      common      |   23  |   0   |   0   |   3   ||   18  |   0   |
     ---------------------------------------------------------------------
[ivy:resolve]
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve]         module not found: 
org.apache.hadoop#hadoop-common;0.21.0
[ivy:resolve]     ==== apache-snapshot: tried
[ivy:resolve]       
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
[ivy:resolve]       -- artifact 
org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
[ivy:resolve]       
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
[ivy:resolve]     ==== maven2: tried
[ivy:resolve]       
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
[ivy:resolve]       -- artifact 
org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
[ivy:resolve]       
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
[ivy:resolve]         module not found: org.apache.hadoop#hadoop-hdfs;0.21.0
[ivy:resolve]     ==== apache-snapshot: tried
[ivy:resolve]       
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
[ivy:resolve]       -- artifact 
org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
[ivy:resolve]       
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
[ivy:resolve]     ==== maven2: tried
[ivy:resolve]       
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
[ivy:resolve]       -- artifact 
org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
[ivy:resolve]       
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
[ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]         ::          UNRESOLVED DEPENDENCIES         ::
[ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]         :: org.apache.hadoop#hadoop-common;0.21.0: not found
[ivy:resolve]         :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
[ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS

BUILD FAILED
/home/rgrandl/hadoop-0.21.0/mapred/src/contrib/build-contrib.xml:327: 
impossible to resolve dependencies:
     resolve failed - see output for details

Total time: 6 seconds
-------------------------------------------------------------------------------------------------------------------------------------------

Can somebody explains me what I miss ?
Or how to compile any of the schedulers from hadoop-0.21.0 ?

Thank you very much for any help,
Robert

Mime
View raw message