drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kunal Khatua (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (DRILL-5287) Provide option to skip updates of ephemeral state changes in Zookeeper
Date Tue, 28 Mar 2017 06:15:41 GMT

     [ https://issues.apache.org/jira/browse/DRILL-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Kunal Khatua closed DRILL-5287.

Verified by running a SQLLine session with the update disabled and running a sufficiently
long running query. The web-UI does not list the query in running state, but only when the
query is complete and the web-page refreshed. 

> Provide option to skip updates of ephemeral state changes in Zookeeper
> ----------------------------------------------------------------------
>                 Key: DRILL-5287
>                 URL: https://issues.apache.org/jira/browse/DRILL-5287
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.9.0
>            Reporter: Padma Penumarthy
>            Assignee: Padma Penumarthy
>              Labels: doc-impacting, ready-to-commit
>             Fix For: 1.10.0
> We put transient profiles in zookeeper and update state as query progresses and changes
states. It is observed that this adds latency of ~45msec for each update in the query execution
path. This gets even worse when high number of concurrent queries are in progress. For concurrency=100,
the average query response time even for short queries  is 8 sec vs 0.2 sec with these updates
disabled. For short lived queries in a high-throughput scenario, it is of no value to update
state changes in zookeeper. We need an option to disable these updates for short running operational

This message was sent by Atlassian JIRA

View raw message