drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5287) Provide option to skip updates of ephemeral state changes in Zookeeper
Date Wed, 01 Mar 2017 07:33:45 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889680#comment-15889680

ASF GitHub Bot commented on DRILL-5287:

Github user sudheeshkatkam commented on the issue:

    +1 (minor comment)

> Provide option to skip updates of ephemeral state changes in Zookeeper
> ----------------------------------------------------------------------
>                 Key: DRILL-5287
>                 URL: https://issues.apache.org/jira/browse/DRILL-5287
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.9.0
>            Reporter: Padma Penumarthy
>            Assignee: Padma Penumarthy
>             Fix For: 1.10.0
> We put transient profiles in zookeeper and update state as query progresses and changes
states. It is observed that this adds latency of ~45msec for each update in the query execution
path. This gets even worse when high number of concurrent queries are in progress. For concurrency=100,
the average query response time even for short queries  is 8 sec vs 0.2 sec with these updates
disabled. For short lived queries in a high-throughput scenario, it is of no value to update
state changes in zookeeper. We need an option to disable these updates for short running operational

This message was sent by Atlassian JIRA

View raw message