hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <>
Subject [jira] [Resolved] (HIVE-11173) Fair ordering of fragments in wait queue
Date Thu, 02 Jul 2015 20:03:04 GMT


Prasanth Jayachandran resolved HIVE-11173.
       Resolution: Fixed
    Fix Version/s: llap

Committed to llap branch.

> Fair ordering of fragments in wait queue
> ----------------------------------------
>                 Key: HIVE-11173
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>    Affects Versions: llap
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>             Fix For: llap
>         Attachments: HIVE-11173.patch
> Wait queue ordering is currently based on the following
> 1) Finishable or not
> 2) Vertex parallelism
> 3) Attempt start time
> This ordering has issues in cases when 2 or more queries are execute in parallel, then
all map tasks gets scheduled first even though reduce task of some dag are in finishable state.
This will make the first submitted query slower even though it can proceed to completion.
> Add fair ordering to wait queue comparator to take dag submission time into account.
For the above scenario, if we take dag submission time into account, the first submitted task
will proceed to completion.

This message was sent by Atlassian JIRA

View raw message