drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1170) YARN support for Drill
Date Mon, 11 Jul 2016 05:31:11 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370193#comment-15370193
] 

ASF GitHub Bot commented on DRILL-1170:
---------------------------------------

GitHub user paul-rogers opened a pull request:

    https://github.com/apache/drill/pull/542

    DRILL 4581 Final

    Extensive revisions to the Drill launch scripts to fix a number of
    bugs, and to prepare the scripts for use in Drill-on-YARN. Unit tests
    will be merged as part of the Drill-on-YARN (DRILL-1170) work.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/paul-rogers/drill DRILL-4581-Final

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/542.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #542
    
----
commit abbfe84e35517c37f59a507694a4f0224137d2b8
Author: Paul Rogers <progers@maprtech.com>
Date:   2016-04-08T21:04:40Z

    Merge remote-tracking branch 'apache/master'

commit e68ab2d8c50ce4d64631f410cbcbe7f4e98aeb8c
Author: Paul Rogers <progers@maprtech.com>
Date:   2016-04-13T23:27:06Z

    Merge remote-tracking branch 'apache/master'

commit ce7d43be1808690f80f6a3c0a826ffb2725ef817
Author: Paul Rogers <progers@maprtech.com>
Date:   2016-07-11T02:55:09Z

    Merge remote-tracking branch 'apache/master'

commit be6564522fe46003d5f5c760ee41fcf71c432a56
Author: Paul Rogers <progers@maprtech.com>
Date:   2016-07-11T03:24:46Z

    DRILL-4581
    
    Extensive revisions to the Drill launch scripts to fix a number of
    bugs, and to prepare the scripts for use in Drill-on-YARN. Unit tests
    will be merged as part of the Drill-on-YARN (DRILL-1170) work.

----


> YARN support for Drill
> ----------------------
>
>                 Key: DRILL-1170
>                 URL: https://issues.apache.org/jira/browse/DRILL-1170
>             Project: Apache Drill
>          Issue Type: New Feature
>            Reporter: Neeraja
>            Assignee: Paul Rogers
>             Fix For: Future
>
>         Attachments: Drill-on-YARNDesignOverview.pdf, Drill-on-YARNUserGuide.pdf
>
>
> This is a tracking item to make Drill work with YARN.
> Below are few requirements/needs to consider.
> - Drill should run as an YARN based application, side by side with other YARN enabled
applications (on same nodes or different nodes). Both memory and CPU resources of Drill should
be controlled in this mechanism.
> - As an YARN enabled application, Drill resource consumption should be adaptive to the
load on the cluster. For ex: When there is no load on the Drill , Drill should consume no
resources on the cluster.  As the load on Drill increases, resources permitting, usage should
grow proportionally.
> - Low latency is a key requirement for Apache Drill along with support for multiple users
(concurrency in 100s-1000s). This should be supported when run as YARN application as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message