hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-12984) spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree
Date Wed, 10 Feb 2016 02:16:18 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140213#comment-15140213
] 

Sergey Shelukhin edited comment on HIVE-12984 at 2/10/16 2:15 AM:
------------------------------------------------------------------

They actually get pulled into deployed artifacts on mvn deploy, I don't think out packaging
filters can affect that. I am cutting the 4th RC now and it's kind of tiresome to delete them
every time (after forgetting and noticing the source zip is 300Mb). 
Why do spark tests need to depend on the package instead of just individual jars? MiniTez
and MiniMr (and MiniHdfs and MiniHBase and MiniAccumulo) all run fine with just jars. Otherwise,
is it possible to file a spark JIRA to have a distribution without Hive if there's no way
around it?


was (Author: sershe):
They actually get pulled into deployed artifacts on mvn deploy, I don't think out packaging
filters can affect that. I am cutting the 4th RC now and it's kind of tiresome to delete them
every time. 
Why do spark tests need to depend on the package instead of just individual jars? MiniTez
and MiniMr (and MiniHdfs and MiniHBase and MiniAccumulo) all run fine with just jars. Otherwise,
is it possible to file a spark JIRA to have a distribution without Hive if there's no way
around it?

> spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree
> --------------------------------------------------------------------------------------
>
>                 Key: HIVE-12984
>                 URL: https://issues.apache.org/jira/browse/HIVE-12984
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-12984.patch
>
>
> Currently, tgz files are downloaded and kept around forever. I noticed when packaging
the release (apparently the excludes in packaging files also didn't work) that the initial
src tar.gz was huge; regardless of that, I had 6 version of spark (1.2 thru 1.6 with one dot
version) sitting there, and also in every clone of Hive that I have.
> These should be switched to use normal means of artifact distribution (I think I already
filed a jira but I cannot find it now); meanwhile making sure that mvn clean would remove
them.
> I realize it could create some pain when running tests repeatedly on dev machine unless
"clean" is omitted from rebuilds; that is somewhat intentional - it should be a good incentive
to switch to maven for dependency management instead of a bash script ;)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message