hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Capriolo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3127) Don’t pass–hconf values as command line arguments to child JVM to avoid command line exceeding char limit on windows
Date Tue, 19 Jun 2012 00:45:42 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396419#comment-13396419
] 

Edward Capriolo commented on HIVE-3127:
---------------------------------------

I vote we remove the arguments options entirely. Unix/Linux has the same max command line
argument issue although people hit it less frequently because it is larger. We do not need
two code paths and the performance of writing a file is nothing compared to overall mr time.
                
> Don’t pass–hconf values as command line arguments to child JVM to avoid command line
exceeding char limit on windows
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-3127
>                 URL: https://issues.apache.org/jira/browse/HIVE-3127
>             Project: Hive
>          Issue Type: Bug
>          Components: Configuration, Windows
>    Affects Versions: 0.9.0, 0.10.0, 0.9.1
>            Reporter: Kanna Karanam
>              Labels: Windows
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3127.1.patch.txt
>
>
> The maximum length of the DOS command string is 8191 characters (in Windows latest versions
http://support.microsoft.com/kb/830473). This limit will be exceeded easily when it appends
individual –hconf values to the command string. To work around this problem, Write all changed
hconf values to a temp file and pass the temp file path to the child jvm to read and initialize
the -hconf parameters from file.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message