hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15688) LlapServiceDriver - an option to get rid of run.sh
Date Thu, 02 Feb 2017 19:43:51 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850372#comment-15850372
] 

Sergey Shelukhin commented on HIVE-15688:
-----------------------------------------

run.sh is still generated, and could be used to restart the cluster. I can change the default
behavior though. Having an extra JVM still has a lot of overhead given how big Hive classpath,
configs, etc. is, and most of the time people want to start the cluster immediately after
generating the package.

> LlapServiceDriver - an option to get rid of run.sh
> --------------------------------------------------
>
>                 Key: HIVE-15688
>                 URL: https://issues.apache.org/jira/browse/HIVE-15688
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-15688.patch
>
>
> run.sh is very slow because it's 4 calls to slider, which means 4 JVMs, 4 connections
to RM and other crap, for   2-5sec. of overhead per call, depending on the machine/cluster.
> What we need is a mode for llapservicedriver that would not generate run.sh, but would
rather run the cluster immediately by calling the corresponding 4 slider APIs. Should probably
be the default, too. For compat with scripts we might generate blank run.sh for now.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message