hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Prakash (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7985) maven build should be super fast when there are no changes
Date Wed, 21 Mar 2012 18:19:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234795#comment-13234795
] 

Ravi Prakash commented on HADOOP-7985:
--------------------------------------

Thanks to Jason (who's too shy to comment on this JIRA =P hahaha)
{quote}
I did some investigation a while ago, thought I mentioned the protobuf/records regenerating
java code each time
plus package-info.java files are being recompiled each time
org.apache.hadoop.jmx, org.apache.hadoop.mapred.tools, org.apache.hadoop.tools, org.apache.hadoop.tools.rumen
Because those files generate no .class file when compiled (there's no annotation on the package
declaration that causes the compiler to generate any code, so it reinvokes the compiler on
them each time like the Touchz problem)
There's also a number of empty java files that cause the same issue
hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AggregatedLogsBlock.java
hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/AggregatedLogsPage.java
hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/MockApp.java
hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/MockContainer.java
it all adds up since it has to update the jar each time it recompiles something
getting the protobuf,records,testcode not to regenerate each time is probably a big part of
it
I think there's other problems beyond that, but ran out of time to look into it further
anyway, hope it helps!
{quote}
                
> maven build should be super fast when there are no changes
> ----------------------------------------------------------
>
>                 Key: HADOOP-7985
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7985
>             Project: Hadoop Common
>          Issue Type: Wish
>          Components: build
>    Affects Versions: 0.23.0
>            Reporter: Ravi Prakash
>              Labels: build, maven
>
> I use this command "mvn -Pdist -P-cbuild -Dmaven.javadoc.skip -DskipTests install" to
build. Without ANY changes in code, running this command takes 1:32. It seems to me this is
too long. Investigate if this time can be reduced drastically.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message