drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanifi Gunes (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-4136) Enhance queue support to take query cost & available cluster resources into account
Date Fri, 11 Dec 2015 19:41:46 GMT

     [ https://issues.apache.org/jira/browse/DRILL-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hanifi Gunes updated DRILL-4136:
--------------------------------
    Issue Type: Sub-task  (was: Improvement)
        Parent: DRILL-4186

> Enhance queue support to take query cost & available cluster resources into account
> -----------------------------------------------------------------------------------
>
>                 Key: DRILL-4136
>                 URL: https://issues.apache.org/jira/browse/DRILL-4136
>             Project: Apache Drill
>          Issue Type: Sub-task
>          Components: Execution - Flow
>    Affects Versions: 1.3.0
>            Reporter: Hanifi Gunes
>            Assignee: Hanifi Gunes
>
> Current queue support relies on a distributed semaphore around a fix pre-defined number.
This semaphore indicates the number of queries Drill can run concurrently. Presently, we define
small and large queues where we classify queries based on a threshold and use two semaphores
around small and large queues individually. 
> This issue proposes to come up with an enhanced queueing or query dispatch mechanism
where a query is granted execution based on its cost and availability of system resources(cpu,
io, memory etc). Enhancing cost planing and introducing a distributed resource management
should be addressed later to fully benefit from this enhancement. The proposal is a non-blocking
and asynchronous mechanism that assumes eventual consistency around available system resources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message