drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abdel Hakim Deneche <adene...@maprtech.com>
Subject [What is the purpose of ExternalSort's MAX_SORT_BYTES
Date Tue, 25 Aug 2015 21:56:45 GMT
When running a window function query on large datasets,
increasing planner.memory.max_query_memory_per_node can actually help the
query not run out of memory. But in some cases this can cause some issues
(see DRILL-3555 <https://issues.apache.org/jira/browse/DRILL-3555>)

This seems to be caused by a hardcoded limit in ExternalSort called
MAX_SORT_BYTES. What is the purpose of this limit ?


Abdelhakim Deneche

Software Engineer


Now Available - Free Hadoop On-Demand Training

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message