hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-984) Building Hive occasionally fails with Ivy error: hadoop#core;0.20.1!hadoop.tar.gz(source): invalid md5:
Date Fri, 08 Jan 2010 22:03:54 GMT

    [ https://issues.apache.org/jira/browse/HIVE-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798195#action_12798195
] 

Zheng Shao commented on HIVE-984:
---------------------------------

-1 on the current patch based on comments from HIVE-487.
I think it makes sense to compile Hive with every supported major version of hadoop so that
we only need to deploy a single set of hive for all versions of hadoop.

{quote}
Todd Lipcon added a comment - 30/Jul/09 05:34 PM
Patch looks good for me (just inspected it visually over here)
One question: once we use these shims, is it possible that we could have just a single hive
distribution which works for all versions of Hadoop? I think we may be able to accomplish
this by making the shim jar output be libs/shims/hive_shims-{$hadoop.version.prefix}.jar.
Then either through ClassLoader magic or shell wrapper magic, we put the right one on the
classpath at runtime based on which hadoop version is on the classpath.
Is this possible? Having different tarballs of hive for different versions of hadoop makes
our lives slightly difficult for packaging.
{quote}


Can we keep building 4 versions of hadoop as hive is doing now?


> Building Hive occasionally fails with Ivy error: hadoop#core;0.20.1!hadoop.tar.gz(source):
invalid md5:
> -------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-984
>                 URL: https://issues.apache.org/jira/browse/HIVE-984
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Build Infrastructure
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>         Attachments: HIVE-984.2.patch, HIVE-984.patch
>
>
> Folks keep running into this problem when building Hive from source:
> {noformat}
> [ivy:retrieve]
> [ivy:retrieve] :: problems summary ::
> [ivy:retrieve] :::: WARNINGS
> [ivy:retrieve]          [FAILED     ]
> hadoop#core;0.20.1!hadoop.tar.gz(source): invalid md5:
> expected=hadoop-0.20.1.tar.gz: computed=719e169b7760c168441b49f405855b72
> (138662ms)
> [ivy:retrieve]          [FAILED     ]
> hadoop#core;0.20.1!hadoop.tar.gz(source): invalid md5:
> expected=hadoop-0.20.1.tar.gz: computed=719e169b7760c168441b49f405855b72
> (138662ms)
> [ivy:retrieve]  ==== hadoop-resolver: tried
> [ivy:retrieve]
> http://archive.apache.org/dist/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz
> [ivy:retrieve]          ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:retrieve]          ::              FAILED DOWNLOADS            ::
> [ivy:retrieve]          :: ^ see resolution messages for details  ^ ::
> [ivy:retrieve]          ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:retrieve]          :: hadoop#core;0.20.1!hadoop.tar.gz(source)
> [ivy:retrieve]          ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:retrieve]
> [ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> {noformat}
> The problem appears to be either with a) the Hive build scripts, b) ivy, or c) archive.apache.org
> Besides fixing the actual bug, one other option worth considering is to add the Hadoop
jars to the
> Hive source repository.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message