hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Grandl <rgra...@student.ethz.ch>
Subject Re: Compile Scheduler from source code
Date Fri, 14 Jan 2011 16:31:14 GMT
I am still not able to compile scheduler code in Hadoop-0.21

I tried to use eclipse and svn checkout.

I have the trunk, right click on the fairshare build.xml file and run.

However, I got a bunch of errors like:
[ivy:cachepath] :: loading settings :: file = 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/ivy/ivysettings.xml
compile:
      [echo] contrib: fairscheduler
     [javac] Compiling 19 source files to 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/build/contrib/fairscheduler/classes
     [javac] 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:21:

package org.apache.hadoop.mapreduce does not exist
     [javac] import org.apache.hadoop.mapreduce.TaskType;
     [javac]                                   ^
     [javac] 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/LoadManager.java:25:

package org.apache.hadoop.mapreduce does not exist
     [javac] import org.apache.hadoop.mapreduce.TaskType;
     [javac]                                   ^
     [javac] 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:51:

cannot find symbol
     [javac] symbol  : class TaskTrackerStatus
     [javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
     [javac]   public boolean canAssignMap(TaskTrackerStatus tracker,
     [javac]                               ^
     [javac] 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:58:

cannot find symbol
     [javac] symbol  : class TaskTrackerStatus
     [javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
     [javac]   public boolean canAssignReduce(TaskTrackerStatus tracker,
     [javac]                                  ^
     [javac] 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:65:

cannot find symbol
     [javac] symbol  : class TaskTrackerStatus
     [javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
     [javac]   public boolean canLaunchTask(TaskTrackerStatus tracker,
     [javac]                                ^
     [javac] 
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:66:

cannot find symbol
     [javac] symbol  : class JobInProgress
     [javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
     [javac]       JobInProgress job,  TaskType type) {
     [javac]       ^

as it seems I don't have package org.apache.hadoop.mapreduce.


Could somebody point me out how to compile the code ?

I am not such an expert on using eclipse but also don't know how to try 
other solution.

Thank you very much for any help,
Robert


On 01/14/2011 03:47 PM, Robert Grandl wrote:
> Thanks for your reply.
>
> However, I don't know what is Maven repository.
>
> Could you be more detailed on what exactly I should put where ?
>
> I would like an easy way to recompile schedulers source code.
>
> Many thanks,
> Robert
>
> On 01/14/2011 03:42 PM, Harsh J wrote:
>    
>> Hi,
>>
>> On Fri, Jan 14, 2011 at 7:48 PM, Robert Grandl<rgrandl@student.ethz.ch>   wrote:
>>
>>      
>>> [ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
>>> [ivy:resolve]         ::          UNRESOLVED DEPENDENCIES         ::
>>> [ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
>>> [ivy:resolve]         :: org.apache.hadoop#hadoop-common;0.21.0: not found
>>> [ivy:resolve]         :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
>>> [ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
>>>
>>>        
>> 0.21.0 jars aren't in Maven yet. I think they'll be in after 0.21.1.
>> For now, add those jars to your local maven repository manually to get
>> the build working.
>>
>> Or you could use trunk, if it is purely for development purposes.
>>
>>
>>      
>    


Mime
View raw message