hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-14453) Split the maven modules into several profiles
Date Wed, 24 May 2017 21:29:04 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tsz Wo Nicholas Sze updated HADOOP-14453:
-----------------------------------------
    Attachment: c14453_20170524.patch

c14453_20170524.patch: splits the modules into 4 profiles:
- common-modules
- hdfs-modules
- yarn-modules
- other-modules

Then, we may skip building some of the modules by disabling some profiles. For example, the
following command build on common and hdfs modules.
{code}
mvn -P-yarn-modules,-other-modules test -Dtest=...
{code}

> Split the maven modules into several profiles
> ---------------------------------------------
>
>                 Key: HADOOP-14453
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14453
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: c14453_20170524.patch
>
>
> Current all the modules are defined at directly under <project>.  As a result,
we cannot select to build only some of the modules.  We have to build all the modules in any
cases and, unfortunately, it takes a long time.
> We propose split all the modules into multiple profiles so that we could build some of
the modules by disabling some of the profiles.  All the profiles are enabled by default so
that all the modules will be built by default. 
> For example, when we are making change in common.  We could build and run tests under
common by disabling hdfs, yarn, mapreduce, etc. modules.  This will reduce the development
time spend on compiling unrelated modules.
> Note that this is for local maven builds.   We are not proposing to change Jenkins builds,
which always build all the modules.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message