Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Tue, 7 Mar 2017 10:38:38 +0000 (UTC)
From: "Lefty Leverenz (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13042200.1486766095000.191.1488883118138@Atlassian.JIRA>
In-Reply-To: <JIRA.13042200.1486766095000@Atlassian.JIRA>
References: <JIRA.13042200.1486766095000@Atlassian.JIRA> <JIRA.13042200.1486766095306@jira-lw-us.apache.org>
Subject: [jira] [Comment Edited] (HIVE-15881) Use
 hive.exec.input.listing.max.threads variable name instead of
 mapred.dfsclient.parallelism.max
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Tue, 07 Mar 2017 10:38:45 -0000


    [ https://issues.apache.org/jira/browse/HIVE-15881?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1588=
8510#comment-15888510 ]=20

Lefty Leverenz edited comment on HIVE-15881 at 3/7/17 10:37 AM:
----------------------------------------------------------------

[~leftylev] I added a few configurations on the wiki used for blobstore.
[https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#=
ConfigurationProperties-Blobstore(i.e.AmazonS3)]


was (Author: spena):
[~leftylev] I added a few configurations on the wiki used for blobstore.
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#C=
onfigurationProperties-Blobstore(i.e.AmazonS3)

> Use hive.exec.input.listing.max.threads variable name instead of mapred.d=
fsclient.parallelism.max
> -------------------------------------------------------------------------=
------------------------
>
>                 Key: HIVE-15881
>                 URL: https://issues.apache.org/jira/browse/HIVE-15881
>             Project: Hive
>          Issue Type: Task
>          Components: Query Planning
>            Reporter: Sergio Pe=C3=B1a
>            Assignee: Sergio Pe=C3=B1a
>            Priority: Minor
>              Labels: TODOC2.2
>             Fix For: 2.2.0
>
>         Attachments: HIVE-15881.1.patch, HIVE-15881.2.patch, HIVE-15881.3=
.patch, HIVE-15881.4.patch, HIVE-15881.5.patch, HIVE-15881.6.patch
>
>
> The Utilities class has two methods, {{getInputSummary}} and {{getInputPa=
ths}}, that use the variable {{mapred.dfsclient.parallelism.max}} to get th=
e summary of a list of input locations in parallel. These methods are Hive =
related, but the variable name does not look it is specific for Hive.
> Also, the above variable is not on HiveConf nor used anywhere else. I jus=
t found a reference on the Hadoop MR1 code.
> I'd like to propose the deprecation of {{mapred.dfsclient.parallelism.max=
}}, and use a different variable name, such as {{hive.get.input.listing.num=
.threads}}, that reflects the intention of the variable. The removal of the=
 old variable might happen on Hive 3.x


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)