hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anishek Agarwal (Jira)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-23787) Write all the events present in a task_queue in a single file.
Date Wed, 01 Jul 2020 09:34:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-23787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anishek Agarwal updated HIVE-23787:
-----------------------------------
    Description: 
Events are not written to file when the queue becomes full, and it ignores the post_exec_hook
/ pre_exec_hook event. The default capacity is 64 in hive.hook.proto.queue.capacity config
for hs2.

Now, we will increase the queue-capacity (let's say upto 256).
Also for the optimisation, need to run all the events present in a task_queue, and write in
a single file.

  was:
DAS does not get the event when the queue becomes full, and it ignores the post_exec_hook
/ pre_exec_hook event. The default capacity is 64 in hive.hook.proto.queue.capacity config
for hs2.

Now, we will increase the queue-capacity (let's say upto 256).
Also for the optimisation, need to run all the events present in a task_queue, and write in
a single file.


> Write all the events present in a task_queue in a single file.
> --------------------------------------------------------------
>
>                 Key: HIVE-23787
>                 URL: https://issues.apache.org/jira/browse/HIVE-23787
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Amlesh Kumar
>            Assignee: Amlesh Kumar
>            Priority: Major
>
> Events are not written to file when the queue becomes full, and it ignores the post_exec_hook
/ pre_exec_hook event. The default capacity is 64 in hive.hook.proto.queue.capacity config
for hs2.
> Now, we will increase the queue-capacity (let's say upto 256).
> Also for the optimisation, need to run all the events present in a task_queue, and write
in a single file.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message