hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7560) Make hadoop-common a POM module with sub-modules (common & alfredo)
Date Tue, 23 Aug 2011 19:49:30 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089701#comment-13089701
] 

Alejandro Abdelnur commented on HADOOP-7560:
--------------------------------------------

Arun, I'd like to keep Alfredo as a separate module. The main reason is that that its runtime
dependencies are minimal:

{code}
[INFO] org.apache.hadoop:hadoop-alfredo:jar:0.23.0-SNAPSHOT
[INFO] +- org.slf4j:slf4j-api:jar:1.5.11:compile
[INFO] +- commons-codec:commons-codec:jar:1.4:compile
[INFO] +- log4j:log4j:jar:1.2.15:compile
[INFO] \- org.slf4j:slf4j-log4j12:jar:1.5.11:compile
{code}

(plus slf4j & log4j don't come when used in client mode, they are optional)

On the other hand, Hadoop Common dependencies are:

{code}
[INFO] org.apache.hadoop:hadoop-common:jar:0.23.0-SNAPSHOT
[INFO] +- com.google.guava:guava:jar:r09:compile
[INFO] +- commons-cli:commons-cli:jar:1.2:compile
[INFO] +- org.apache.commons:commons-math:jar:2.1:compile
[INFO] +- xmlenc:xmlenc:jar:0.52:compile
[INFO] +- commons-httpclient:commons-httpclient:jar:3.1:compile
[INFO] +- commons-codec:commons-codec:jar:1.4:compile
[INFO] +- commons-net:commons-net:jar:1.4.1:compile
[INFO] +- javax.servlet:servlet-api:jar:2.5:compile
[INFO] +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] +- tomcat:jasper-compiler:jar:5.5.23:compile
[INFO] +- tomcat:jasper-runtime:jar:5.5.23:compile
[INFO] +- javax.servlet.jsp:jsp-api:jar:2.1:compile
[INFO] +- commons-el:commons-el:jar:1.0:compile
[INFO] +- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] +- commons-logging:commons-logging-api:jar:1.1:compile
[INFO] +- log4j:log4j:jar:1.2.15:compile
[INFO] +- net.java.dev.jets3t:jets3t:jar:0.6.1:compile
[INFO] +- commons-lang:commons-lang:jar:2.5:compile
[INFO] +- commons-collections:commons-collections:jar:3.2.1:compile
[INFO] +- commons-configuration:commons-configuration:jar:1.6:compile
[INFO] |  +- commons-digester:commons-digester:jar:1.8:compile
[INFO] |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
[INFO] |  \- commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
[INFO] +- hsqldb:hsqldb:jar:1.8.0.7:compile
[INFO] +- org.slf4j:slf4j-api:jar:1.5.11:compile
[INFO] +- org.slf4j:slf4j-log4j12:jar:1.5.11:compile
[INFO] +- org.eclipse.jdt:core:jar:3.1.1:compile
[INFO] +- oro:oro:jar:2.0.8:compile
[INFO] +- org.codehaus.jackson:jackson-mapper-asl:jar:1.6.9:compile
[INFO] |  \- org.codehaus.jackson:jackson-core-asl:jar:1.6.9:compile
[INFO] +- org.aspectj:aspectjrt:jar:1.6.5:compile
[INFO] +- org.apache.avro:avro:jar:1.5.2:compile
[INFO] |  +- com.thoughtworks.paranamer:paranamer:jar:2.3:compile
[INFO] |  \- org.xerial.snappy:snappy-java:jar:1.0.3-rc4:compile
[INFO] +- org.apache.avro:avro-ipc:jar:1.5.2:compile
[INFO] |  +- org.jboss.netty:netty:jar:3.2.4.Final:compile
[INFO] |  \- org.apache.velocity:velocity:jar:1.7:compile
[INFO] +- net.sf.kosmosfs:kfs:jar:0.3:compile
[INFO] +- com.google.protobuf:protobuf-java:jar:2.4.0a:compile
[INFO] \- org.apache.hadoop:hadoop-alfredo:jar:0.23.0-SNAPSHOT:compile
{code}

This is not really minimal. And having to exclude all of them when just wanting to use Alfredo
client it not very developer friendly.


Regarding the module names and organization, I'll be posting a comment a bit later today once
I finish writing it up.

> Make hadoop-common a POM module with sub-modules (common & alfredo)
> -------------------------------------------------------------------
>
>                 Key: HADOOP-7560
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7560
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>
> Currently hadoop-common is a JAR module, thus it cannot aggregate sub-modules.
> Changing it to POM module it makes it an aggregator module, all the code under hadoop-common
must be moved to a sub-module.
> I.e.:
> mkdir hadoop-common-project
> mv hadoop-common hadoop-common-project
> mv hadoop-alfredo hadoop-common-project
> hadoop-common-project/pom.xml is a POM module that aggregates common & alfredo

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message