hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Travis Crawford (JIRA)" <>
Subject [jira] [Commented] (HIVE-4278) HCat needs to get current Hive jars instead of pulling them from maven repo
Date Fri, 05 Apr 2013 19:35:17 GMT


Travis Crawford commented on HIVE-4278:

Thanks for the high-level feedback.

Quick summary of the Hive/HCatalog build. Both Hive & HCatalog use ant as their build
system. A difference is Hive uses Ivy to resolve dependencies, while HCatalog uses maven (through
its maven-ant-tasks integration) to resolve dependencies. HCatalog does *not* use maven for
its build - just resolving dependencies.

With the summary in mind, the problem we're trying to solve here is during a Hive build, make
the currently built jars available to HCatalog. Hive already has support for fetching artifacts
from Maven repos, and with a relatively minor change we can publish Hive jars to the local
maven repo, which makes the artifacts available to both dependency resolution tools. Overall
I view this as a pretty minor change.

That said, I believe our long-term goal is integrating HCatalog into Hive as a first-class
citizen, which I assume means merging the build scripts & using a single tool for dependency
resolution. Once we determine ivy/maven-ant-tasks as the tool we want both project to use
I think we should open a jira to track the transition. Additionally, I'd love to make some
improvements to the Hive build, through the lens of simplification (I think there are some
quick wins) and merging the hive/hcat ant targets.

That's the run-down of what's going on here. This unblocks other HCat integration work, and
once we have a build system integration plan we can do that as a separate issue.
> HCat needs to get current Hive jars instead of pulling them from maven repo
> ---------------------------------------------------------------------------
>                 Key: HIVE-4278
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Build Infrastructure, HCatalog
>    Affects Versions: 0.11.0
>            Reporter: Alan Gates
>            Assignee: Travis Crawford
>            Priority: Blocker
>             Fix For: 0.11.0
>         Attachments: HIVE-4278.D9981.1.patch
> The HCatalog build is currently pulling Hive jars from the maven repo instead of using
the ones built as part of the current build.  Now that it is part of Hive it should use the
jars being built instead of pulling them from maven.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message