drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Phillips" <sphill...@maprtech.com>
Subject Review Request 33001: DRILL-2725: Faster work assignment logic
Date Thu, 09 Apr 2015 22:55:05 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33001/
-----------------------------------------------------------

Review request for drill, Jacques Nadeau and Jason Altekruse.


Repository: drill-git


Description
-------

The current AssignmentCreator logic for assigning work to drillbits takes a non-negligible
amount of time once the number of work units is more than a few thousand
We need a new algorithm to that will cut this time down to less than a second, even for tables
with more than 100K files.


Diffs
-----

  exec/java-exec/src/main/java/org/apache/drill/exec/store/schedule/AssignmentCreator.java
7e9c4c9 

Diff: https://reviews.apache.org/r/33001/diff/


Testing
-------


Thanks,

Steven Phillips


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message