hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <>
Subject [jira] [Updated] (HIVE-9420) LLAP: separate decoding thread from read/uncompress thread
Date Sat, 11 Jul 2015 00:40:04 GMT


Sergey Shelukhin updated HIVE-9420:
    Attachment: HIVE-9420.WIP.patch

Something like this... need to finish it

> LLAP: separate decoding thread from read/uncompress thread
> ----------------------------------------------------------
>                 Key: HIVE-9420
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-9420.WIP.patch
> Right now reader is a callable that is dumped into threadpool, and all the data loading
for one request happens on one thread (in parallel with operator pipeline).
> We might want to separate reading from HDFS/decompressing data, from decoding data and
low-level row-level SARGs (that, and high level cache which is AWOL now, were the reasons
for encoded data production separation from final VRB production)

This message was sent by Atlassian JIRA

View raw message