hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kanna Karanam (JIRA)" <>
Subject [jira] [Commented] (HIVE-3172) Remove the duplicate JAR entries from the (“test.classpath”) to avoid command line exceeding char limit on windows
Date Fri, 22 Jun 2012 01:44:42 GMT


Kanna Karanam commented on HIVE-3172:

@Carl - All MiniMR cluster related test cases are failing when hadoop is attempting to run
the MR jobs.
I am debating on following two approaches-.

1) Create a custom ANT task that takes the list of folders/filesets as an input and enumerates
files from each folder and adds to list/classpath if doesn’t exist already. (Based on unique
names). I have very limited knowledge on ANT so please let me know if you see any error.
2) Hacky solution is replace the fileset with path element in the test class path.

Please let me know if you see any other possible solutions.

> Remove the duplicate JAR entries from the (“test.classpath”) to avoid command line
exceeding char limit on windows 
> -------------------------------------------------------------------------------------------------------------------
>                 Key: HIVE-3172
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Tests, Windows
>    Affects Versions: 0.10.0
>         Environment: Windows
>            Reporter: Kanna Karanam
>              Labels: Windows
>             Fix For: 0.10.0
> The maximum length of the DOS command string is 8191 characters (in Windows latest versions Following entries in the “build-common.xml” are
adding lot of duplicate JAR entries to the “test.classpath” and it exceeds the max character
limit on windows very easily. 
> <!-- Include build/dist/lib on the classpath before Ivy and exclude hive jars from
Ivy to make sure we get the local changes when we test Hive -->
>     <fileset dir="${build.dir.hive}/dist/lib" includes="*.jar" erroronmissingdir="false"
>     <fileset dir="${hive.root}/build/ivy/lib/test" includes="*.jar" erroronmissingdir="false"
>     <fileset dir="${hive.root}/build/ivy/lib/default" includes="*.jar" erroronmissingdir="false"
excludes="**/hive_*.jar,**/hive-*.jar" />
>     <fileset dir="${hive.root}/testlibs" includes="*.jar"/>
> Proposed solution (workaround)–
> 1)Include all JARs from dist\lib excluding "**/hive_contrib*.jar,**/hive-contrib*.jar,**/lib*.jar"
> 2)Select the specific jars (missing jars) from test/other folders, (that includes Hadoop-*.jar
> Thanks

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message