drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5270) Improve loading of profiles listing in the WebUI
Date Fri, 17 May 2019 21:54:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842636#comment-16842636

ASF GitHub Bot commented on DRILL-5270:

kkhatua commented on pull request #1654: DRILL-5270: Improve loading of profiles listing in
the WebUI
URL: https://github.com/apache/drill/pull/1654
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

> Improve loading of profiles listing in the WebUI
> ------------------------------------------------
>                 Key: DRILL-5270
>                 URL: https://issues.apache.org/jira/browse/DRILL-5270
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Web Server
>    Affects Versions: 1.9.0
>            Reporter: Kunal Khatua
>            Assignee: Kunal Khatua
>            Priority: Major
>             Fix For: 1.17.0
> Currently, as the number of profiles increase, we reload the same list of profiles from
the FS.
> An ideal improvement would be to detect if there are any new profiles and only reload
from the disk then. Otherwise, a cached list is sufficient.
> For a directory of 280K profiles, the load time is close to 6 seconds on a 32 core server.
With the caching, we can get it down to as much as a few milliseconds.
> To render the cache as invalid, we inspect the last modified time of the directory to
confirm whether a reload is needed. 

This message was sent by Atlassian JIRA

View raw message