hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <>
Subject [jira] [Resolved] (HIVE-10474) LLAP: investigate why TPCH Q1 1k is slow
Date Wed, 20 May 2015 23:08:59 GMT


Sergey Shelukhin resolved HIVE-10474.
    Resolution: Duplicate

did some investigation, forgot about this jira, will close the other now.
RPC patch does not significantly change the issue and GC doesn't explain it either (at least
not directly via GC time)

> LLAP: investigate why TPCH Q1 1k is slow
> ----------------------------------------
>                 Key: HIVE-10474
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>         Attachments: llap-gc-pauses.png
> While most queries run faster in LLAP than just Tez with container reuse, TPCH Q1 is
much slower.
> On my run, on tez with container reuse (current default LLAP configuration but mode ==
container and no daemons running)  runs 2-6 (out of 6 consecutive runs in the same session)
finished in 25.5sec average; with 16 LLAP daemons in default config the average was 35.5sec;
same w/o IO elevator (to rule out its impact) it took 59.7sec w/strange distribution (later
runs were slower than earlier runs, still, fastest run was 49.5sec).
> So excluding IO elevator it's more than 2x degradation.
> We need to figure out why this is happening. Is it just slot discrepancy? Regardless,
this needs to be addressed.

This message was sent by Atlassian JIRA

View raw message