hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5107) Change hive's build to maven
Date Fri, 06 Sep 2013 21:13:52 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Brock Noland updated HIVE-5107:
-------------------------------

    Attachment: HIVE-5107-wip.patch

Hi,

I'd really like to help work on this and spent the past a couple days doing so and plan to
work on it next week as well. However, I think we shouldn't commit the change until after
the 0.12 branch has been created. I have attached my WIP patch HIVE-5107-wip.patch. Basically
I borrowed heavily from both Edward's and Owen's approaches with the additional belief that
the conversion we should move as few files as possible until after we have moved to maven.
Thus I have only moves files when it would create a circular dependency.

Current status:

* All java source including tests (minus the generated tests) is compiling
* The new it-tests module contains any test which would have generated a circular dependency
* Generated tests are not being generated (they will be generated in the it-tests module)
* Some tests pass, most do not because the required test.* properties are not set

Time Comparison:

* ant clean package vs mvn clean package
** ant 2.5 minutes
** mvn 30 seconds
* rm -rf ~/.ivy2 && ant very-clean clean package vs rm -rf ~/.m2/repository &&
mvn clean package -DskipTests
** ant 25 minutes
** mvn 5 minutes

How to use:

# Apply patch
# Execute maven-rollfoward.sh

How to patch was generated

# Execute maven-rollback.sh
# git add .
# git status | grep deleted: | awk '{print $NF}' | xargs git rm
# git diff origin/trunk

Next steps:

* Generate TestCli* tests in the it-tests module. Without moving existing tests location.
* Trim down size of hive-ql-$version-exec.jar. It includes all deps at present as opposed
the ones we need.
* Get tests passing.

Output of mvn clean package -DskipTests:

{noformat}
[INFO] Reactor Summary:
[INFO]
[INFO] Hive .............................................. SUCCESS [0.106s]
[INFO] Hive Ant Utilities ................................ SUCCESS [1.066s]
[INFO] Hive Shims Common ................................. SUCCESS [0.392s]
[INFO] Hive Shims 0.20 ................................... SUCCESS [0.243s]
[INFO] Hive Shims Secure Common .......................... SUCCESS [0.414s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [0.133s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [0.409s]
[INFO] Hive Shims ........................................ SUCCESS [0.495s]
[INFO] Hive Common ....................................... SUCCESS [0.484s]
[INFO] Hive Serde ........................................ SUCCESS [2.009s]
[INFO] Hive Metastore .................................... SUCCESS [4.204s]
[INFO] Hive TestUtils .................................... SUCCESS [0.027s]
[INFO] Hive Query Language ............................... SUCCESS [9.673s]
[INFO] Hive Service ...................................... SUCCESS [1.296s]
[INFO] Hive JDBC ......................................... SUCCESS [0.315s]
[INFO] Hive Beeline ...................................... SUCCESS [0.156s]
[INFO] Hive CLI .......................................... SUCCESS [0.210s]
[INFO] Hive Contrib ...................................... SUCCESS [0.201s]
[INFO] Hive HBase Handler ................................ SUCCESS [0.196s]
[INFO] Hive HCatalog ..................................... SUCCESS [0.001s]
[INFO] Hive HCatalog Core ................................ SUCCESS [0.662s]
[INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [0.240s]
[INFO] Hive HCatalog Server Extensions ................... SUCCESS [0.177s]
[INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [0.172s]
[INFO] Hive HCatalog Webhcat ............................. SUCCESS [0.273s]
[INFO] Hive HCatalog HBase Storage Handler ............... SUCCESS [0.307s]
[INFO] Hive HWI .......................................... SUCCESS [0.109s]
[INFO] Hive Integration Tests ............................ SUCCESS [0.030s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 24.490s
[INFO] Finished at: Fri Sep 06 14:45:25 CDT 2013
[INFO] Final Memory: 104M/799M
[INFO] ------------------------------------------------------------------------
{noformat}
                
> Change hive's build to maven
> ----------------------------
>
>                 Key: HIVE-5107
>                 URL: https://issues.apache.org/jira/browse/HIVE-5107
>             Project: Hive
>          Issue Type: Task
>            Reporter: Edward Capriolo
>            Assignee: Edward Capriolo
>         Attachments: HIVE-5107-wip.patch
>
>
> I can not cope with hive's build infrastructure any more. I have started working on porting
the project to maven. When I have some solid progess i will github the entire thing for review.
Then we can talk about switching the project somehow.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message