hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <>
Subject [jira] [Updated] (HIVE-12164) Remove jdbc stats collection mechanism
Date Sat, 17 Oct 2015 17:52:05 GMT


Ashutosh Chauhan updated HIVE-12164:
    Attachment: HIVE-12164.3.patch

> Remove jdbc stats collection mechanism
> --------------------------------------
>                 Key: HIVE-12164
>                 URL:
>             Project: Hive
>          Issue Type: Task
>          Components: Statistics
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, HIVE-12164.3.patch, HIVE-12164.patch
> Though there are some deployments using it, usually its painful to setup since a valid
hive-site.xml is needed on all task nodes (containing connection details) and for large tasks
(with thousands of tasks) results in a scalability issue with all of them hammering DB at
nearly same time.
> Because of these pain points alternative stats collection mechanism were added. FS stats
based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds complexity in
TS and FS operators w.r.t key handling.

This message was sent by Atlassian JIRA

View raw message