ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srimanth Gunturi (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (AMBARI-11837) Simple insert takes up 6 slots with tez: mapreduce.input.fileinputformat.split.minsize=1 should be changed
Date Thu, 18 Jun 2015 06:39:01 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Srimanth Gunturi reopened AMBARI-11837:
---------------------------------------

Commit is causing issues in Hive.

> Simple insert takes up 6 slots with tez: mapreduce.input.fileinputformat.split.minsize=1
should be changed
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-11837
>                 URL: https://issues.apache.org/jira/browse/AMBARI-11837
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>            Reporter: Vitaly Brodetskyi
>            Assignee: Vitaly Brodetskyi
>            Priority: Critical
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-11837.patch
>
>
> {noformat}
> create table test (f1 int, f2 int);
> insert into table test values (10,10);
> {noformat}
> This ends up creating 6 containers (HiveInput creates 6 splits) in hive1 queue in cn041
cluster.  Accidentally one could use couple of JDBC programs to use up all available slots
with simple inserts.
> Appears that "mapreduce.input.fileinputformat.split.minsize" is set to 1. Setting it
to a higher value "mapreduce.input.fileinputformat.split.minsize=1000000" fixes the problem
and launches 1 container. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message