hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17922) Enable runWorker() UDF to launch compactor from .q tests
Date Wed, 08 Nov 2017 21:31:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244757#comment-16244757
] 

Eugene Koifman commented on HIVE-17922:
---------------------------------------

TestAcidOnTez - may be fix Compactor in Qfiles?
hiveConf.setInt(MRJobConfig.MAP_MEMORY_MB, 1024);
hiveConf.setInt(MRJobConfig.REDUCE_MEMORY_MB, 1024);

> Enable runWorker() UDF to launch compactor from .q tests
> --------------------------------------------------------
>
>                 Key: HIVE-17922
>                 URL: https://issues.apache.org/jira/browse/HIVE-17922
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Test, Transactions
>    Affects Versions: 3.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>
> available since HIVE-17458 (via UDFRunWorker.java)
> The idea is to be able to do 
> {noformat}
> alter table over10k_orc_bucketed compact 'major' WITH OVERWRITE TBLPROPERTIES ("compactor.mapreduce.map.memory.mb"="500","compactor.hive.tez.container.size"="500");
>  select runWorker() from mydual;
>  show compactions;
> {noformat}
> but it always fails with
> {noformat}
>  Invalid resource request, requested memory < 0, or requested memory > max configured,
requestedMemory=1536, maxMemory=512
> {noformat}
> ToDo: see if need to fix host name masking in the output from "show compactions"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message