hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcin Kurczych (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2400) Update unittests Hadoop version
Date Wed, 31 Aug 2011 23:47:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094999#comment-13094999
] 

Marcin Kurczych commented on HIVE-2400:
---------------------------------------

I've manually replaced hadoop-core and hadoop-tools jars to Hadoop 0.20.3 ones and everything
almost worked (all tests, including new ones, which were failing because of Hadoop 0.20.1
bugs). There's "almost", because I've run into a problem: VersionInfo.getVersion() was returning
"Unknown" so I hardcoded something like if("Unknown".equals(vers)) vers="0.20.3"; for testing
and then everything went perfect. This must be problem with jars, I've used ones from https://repository.apache.org/index.html#nexus-search;quick~hadoop
.

> Update unittests Hadoop version
> -------------------------------
>
>                 Key: HIVE-2400
>                 URL: https://issues.apache.org/jira/browse/HIVE-2400
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marcin Kurczych
>            Assignee: Marcin Kurczych
>
> Hadoop 0.20.1 used in unittests contains bugs that were fixed in later versions of Hadoop,
for example
> * har:// connections cannot be indexed by (scheme, authority, username) - the path is
significant as well. Caching them in this way limits a hadoop client to opening one archive
per filesystem. It seems to be safe not to cache them, since they wrap another connection
that does the actual networking.
> fixed in https://issues.apache.org/jira/browse/HADOOP-6231 .

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message