hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism
Date Thu, 15 Oct 2015 00:26:05 GMT

     [ https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ashutosh Chauhan updated HIVE-12164:
------------------------------------
    Attachment: HIVE-12164.patch

> Remove jdbc stats collection mechanism
> --------------------------------------
>
>                 Key: HIVE-12164
>                 URL: https://issues.apache.org/jira/browse/HIVE-12164
>             Project: Hive
>          Issue Type: Task
>          Components: Statistics
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup since a valid
hive-site.xml is needed on all task nodes (containing connection details) and for large tasks
(with thousands of tasks) results in a scalability issue with all of them hammering DB at
nearly same time.
> Because of these pain points alternative stats collection mechanism were added. FS stats
based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds complexity in
TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message