drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4132) Ability to submit simple type of physical plan directly to EndPoint DrillBit for execution
Date Mon, 08 Feb 2016 02:10:39 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136556#comment-15136556
] 

ASF GitHub Bot commented on DRILL-4132:
---------------------------------------

GitHub user yufeldman opened a pull request:

    https://github.com/apache/drill/pull/368

    DRILL-4132 Ability to submit simple type of physical plan directly to…

    … EndPoint DrillBit for execution.
    
    There are multiple changes to achieve this:
    1. During physical planning split single plan into multiple based on the number of minor
fragments of the Leaf Major fragment.
       a. Removing exchange operators during planning
       b. Producing just root fragments (that will be also leaf fragments)
    2. Each fragment can be executed against Drillbit it is assigned to, so to keep locality
    Design document can be found in the JIRA: DRILL-4132

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/yufeldman/incubator-drill DRILL-4132

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/368.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #368
    
----
commit 2a35967396dd66c3e371973fe8baf14f720ed219
Author: Yuliya Feldman <yfeldman@maprtech.com>
Date:   2016-02-04T22:09:21Z

    DRILL-4132 Ability to submit simple type of physical plan directly to EndPoint DrillBit
for execution.
    There are multiple changes to achieve this:
    1. During physical planning split single plan into multiple based on the number of minor
fragments of the Leaf Major fragment.
       a. Removing exchange operators during planning
       b. Producing just root fragments (that will be also leaf fragments)
    2. Each fragment can be executed against Drillbit it is assigned to, so to keep locality
    Design document can be found in the JIRA: DRILL-4132

----


> Ability to submit simple type of physical plan directly to EndPoint DrillBit for execution
> ------------------------------------------------------------------------------------------
>
>                 Key: DRILL-4132
>                 URL: https://issues.apache.org/jira/browse/DRILL-4132
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Execution - Flow, Execution - RPC, Query Planning & Optimization
>            Reporter: Yuliya Feldman
>            Assignee: Yuliya Feldman
>
> Today Drill Query execution is optimistic and stateful (at least due to data exchanges)
- if any of the stages of query execution fails whole query fails. If query is just simple
scan, filter push down and project where no data exchange happens between DrillBits there
is no need to fail whole query when one DrillBit fails, as minor fragments running on that
DrillBit can be rerun on the other DrillBit. There are probably multiple ways to achieve this.
This JIRA is to open discussion on: 
> 1. agreement that we need to support above use case 
> 2. means of achieving it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message