hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-6671) To use maven for hadoop common builds
Date Sun, 07 Aug 2011 09:09:27 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080557#comment-13080557
] 

Uma Maheswara Rao G commented on HADOOP-6671:
---------------------------------------------


Any one treid to build the hadoop in Windows7?

I checkout the latest Hadoop trunk code and given the below command in windows.
I ran the below command at root folder.
>mvn clean install -DskipTests

But could not build the project :(

below is the clear info.

[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (clean) @ hadoop-project ---
[WARNING] Rule 2: org.apache.maven.plugins.enforcer.RequireOS failed with messag
e:
OS Arch: x86 Family: windows Name: windows 7 Version: 6.1 is not allowed by Fami
ly=unix
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Project POM ......................... FAILURE [0.552s]
[INFO] Apache Hadoop Assemblies .......................... SKIPPED
[INFO] Apache Hadoop Annotations ......................... SKIPPED
[INFO] Apache Hadoop Common .............................. SKIPPED
[INFO] Apache Hadoop Main ................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE

workaround:
I removed the below tag from <root>/pom.xml, <root>/hadoop-assemblies/pom.xml
& <root>/hadoop-project/pom.xml

<Rules>
 ......
 .....
 <requireOS>
              <family>unix</family>
 </requireOS>

 </Rules>

After removing this i could proceed some extent but did not get success.


Started fialing in annotations.

Trace:

[ERROR] symbol  : variable Standard
[ERROR] location: class org.apache.hadoop.classification.tools.ExcludePrivateAnn
otationsStandardDoclet
[ERROR] \Hadoop_common\hadoop-annotations\src\main\java\org\apache\hadoop\classi
fication\tools\ExcludePrivateAnnotationsJDiffDoclet.java:[36,11] cannot find sym
bol
[ERROR] symbol  : variable LanguageVersion
[ERROR] location: class org.apache.hadoop.classification.tools.ExcludePrivateAnn
otationsJDiffDoclet
[ERROR] \Hadoop_common\hadoop-annotations\src\main\java\org\apache\hadoop\classi
fication\tools\ExcludePrivateAnnotationsJDiffDoclet.java:[42,16] cannot access c
om.sun.javadoc.Doclet
[ERROR] class file for com.sun.javadoc.Doclet not found
[ERROR] return JDiff.start(RootDocProcessor.process(root));
[ERROR] -> [Help 1]
[ERROR]

Looks tools.jar jar is not avialble to class path.

Java lib has the tools.jar but not able to pick.
I tried to use -DskipTests but no help. 

Workaround:
Finally after adding the below entry in hadoop-annotations/pom.xml

  <dependencies>
        ................
        ................
    <dependency>
          <groupId>jdk.tools</groupId>
          <artifactId>jdk.tools</artifactId>
          <version>1.6</version>
          <scope>system</scope>
          <systemPath>${env.JAVA_HOME}/lib/tools.jar</systemPath>
    </dependency>

  </dependencies>



Could see success :-)

[INFO]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.749s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.833s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.809s]
[INFO] Apache Hadoop Common .............................. SUCCESS [33.658s]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.030s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------


Any alternative solutions to work with windows as well? or we need to incorporate this chnages
as well?
Please correct me if i am doing something wrong.

> To use maven for hadoop common builds
> -------------------------------------
>
>                 Key: HADOOP-6671
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6671
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: build
>    Affects Versions: 0.22.0
>            Reporter: Giridharan Kesavan
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-6671-AA.patch, HADOOP-6671-AB.patch, HADOOP-6671-AC.patch,
HADOOP-6671-AC.sh, HADOOP-6671-AD.patch, HADOOP-6671-AD.sh, HADOOP-6671-cross-project-HDFS.patch,
HADOOP-6671-e.patch, HADOOP-6671-f.patch, HADOOP-6671-g.patch, HADOOP-6671-h.patch, HADOOP-6671-i.patch,
HADOOP-6671-j.patch, HADOOP-6671-k.sh, HADOOP-6671-l.patch, HADOOP-6671-m.patch, HADOOP-6671-n.patch,
HADOOP-6671-o.patch, HADOOP-6671-p.patch, HADOOP-6671-q.patch, HADOOP-6671.patch, HADOOP-6671b.patch,
HADOOP-6671c.patch, HADOOP-6671d.patch, build.png, common-mvn-layout-i.sh, hadoop-commons-maven.patch,
mvn-layout-AA.sh, mvn-layout-AB.sh, mvn-layout-e.sh, mvn-layout-f.sh, mvn-layout-k.sh, mvn-layout-l.sh,
mvn-layout-m.sh, mvn-layout-n.sh, mvn-layout-o.sh, mvn-layout-p.sh, mvn-layout-q.sh, mvn-layout.sh,
mvn-layout.sh, mvn-layout2.sh, mvn-layout2.sh
>
>
> We are now able to publish hadoop artifacts to the maven repo successfully [ Hadoop-6382]
> Drawbacks with the current approach:
> * Use ivy for dependency management with ivy.xml
> * Use maven-ant-task for artifact publishing to the maven repository
> * pom files are not generated dynamically 
> To address this I propose we use maven to build hadoop-common, which would help us to
manage dependencies, publish artifacts and have one single xml file(POM) for dependency management
and artifact publishing.
> I would like to have a branch created to work on mavenizing  hadoop common.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message