drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ppadma <...@git.apache.org>
Subject [GitHub] drill issue #639: DRILL-4706: Fragment planning causes Drillbits to read rem...
Date Fri, 04 Nov 2016 22:04:49 GMT
Github user ppadma commented on the issue:

    https://github.com/apache/drill/pull/639
  
    Parallelization logic is affected for following reasons:
    Depending upon how many rowGroups to scan on a node (based on locality information) i.e.
how much work the node has to do, we want to adjust the number of fragments on the node (constrained
to usual global and per node limits). 
    We do not want to schedule fragment(s) on a node which do not have data. 
    Because we want pure locality, we may have fewer fragments doing more work.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message