hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ranjan Banerjee <rbanerj...@wisc.edu>
Subject How to change the scheduler
Date Tue, 06 Mar 2012 22:38:08 GMT

   I am relatively new to Hadoop. Started playing with it around two weeks ago. I have finished
running the canonical word count map reduce example. My class project involves coming with
a different scheduler for Hadoop. I know that by default Hadoop uses the FIFO and it also
has the fair scheduler to be used. Can someone suggest where do I exactly write my scheduler
code and what change do I need to do to the Conf object so that my scheduler is used by Hadoop
and not the default scheduler in scheduling map reduce jobs.


On 03/02/12, mohammed elsaeedy   wrote:
> Dear Mailing list,
>    I've been trying to simply build the hadoop source code on my Macbook
> Pro. I tried following the tutorial mentioned
> here<http://wiki.apache.org/hadoop/EclipseEnvironment>.
> I grabbed the source code from github, and then I try  to run maven:
> mvn install -DskipTests
> mvn clean package -DskipTests -Pdist -Dtar -Dmaven.javadoc.skip=true
> but I always get the following error:
> *[INFO]
> ------------------------------------------------------------------------*
> *[INFO] Total time: 14:48.283s*
> *[INFO] Finished at: Fri Mar 02 13:29:20 EET 2012*
> *[INFO] Final Memory: 68M/123M*
> *[INFO]
> ------------------------------------------------------------------------*
> *[ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-pdf-plugin:1.1:pdf (pdf) on project
> hadoop-distcp: Error during document generation: Error parsing
> /Users/SaSa/Desktop/Hadoop/src/hadoop-common/hadoop-tools/hadoop-distcp/target/pdf/site.tmp/xdoc/index.xml:
> Error validating the model: Fatal error:*
> *[ERROR] Public ID: null*
> *[ERROR] System ID: http://maven.apache.org/xsd/xdoc-2.0.xsd*
> *[ERROR] Line number: 2699*
> *[ERROR] Column number: 5*
> *[ERROR] Message: The element type "xs:element" must be terminated by the
> matching end-tag "</xs:element>".*
> *[ERROR] -> [Help 1]*
> *[ERROR] *
> *[ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.*
> *[ERROR] Re-run Maven using the -X switch to enable full debug logging.*
> *[ERROR] *
> *[ERROR] For more information about the errors and possible solutions,
> please read the following articles:*
> *[ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException*
> *[ERROR] *
> *[ERROR] After correcting the problems, you can resume the build with the
> command*
> *[ERROR]   mvn <goals> -rf :hadoop-distcp*
> I googled for a similar problem, all I got was some people cleared the m2
> and ivy2 cahce, and rerun the command. But unfortunately didn't work for
> me. I've been stuck here, I really hope anyone can help me with this issue.
> Thank you all.
> Regards,
> SaSa
> -- 
> Mohammed El Sayed
> Computer Science Department
> King Abdullah University of Science and Technology
> 2351 - 4700 KAUST, Saudi Arabia
> Home Page <http://cloud.kaust.edu.sa/SiteCollectionDocuments/melsayed.aspx>

View raw message