hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16735) Please add that hive.mapred.local.mem must be set in MBs in the documentation
Date Tue, 23 May 2017 07:03:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020724#comment-16020724
] 

Lefty Leverenz commented on HIVE-16735:
---------------------------------------

This needs to be fixed in HiveConf.java as well as the wiki.  Perhaps the code should be changed
to accept bytes as well as megabytes.

In the wiki *hive.mapred.local.mem* is documented in two places, which should both be fixed:

* [Configuration Properties -- hive.mapred.local.mem | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.mapred.local.mem]
* [Getting Started -- Hive, Map-Reduce and Local-Mode | https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-Hive,Map-ReduceandLocal-Mode]
(last paragraph)

Thanks for filing this bug, Laurel.

> Please add that hive.mapred.local.mem must be set in MBs in the documentation
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-16735
>                 URL: https://issues.apache.org/jira/browse/HIVE-16735
>             Project: Hive
>          Issue Type: Task
>          Components: Documentation
>            Reporter: Laurel Hale
>            Assignee: Lefty Leverenz
>            Priority: Minor
>
> Hi Lefty,
> One of my developers noticed this and we do not document the local mode. Thought I'd
let you know.
> Here's a good place where you could put this:
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution
> There's already a small subsection where hive.mapred.local.mem is documented, but there
isn't any information about how to set the value. My developer discovered that when you set
it in bytes, it throws the following error:
> 2017-03-12 09:24:31,835 ERROR [HiveServer2-Background-Pool: Thread-22163()]: mr.MapredLocalTask
(MapredLocalTask.java:executeInChildVM(341)) - Exception: java.lang.NumberFormatException:
For input string: "4294967296"
> java.lang.NumberFormatException: For input string: "4294967296"
> at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:495)
> at java.lang.Integer.parseInt(Integer.java:527)
> at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1259)
> at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:2415)
> at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:2424)
> at org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask.executeInChildVM(MapredLocalTask.java:228)
> Instead, this value should be set in MBs for success.
> Thanks,
> Laurel



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message