impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fawze Abujaber <fawz...@gmail.com>
Subject Estimate peak memory VS used peak memory
Date Thu, 22 Feb 2018 12:48:22 GMT
Hi Guys,

In Impala version 2.10 i see a lot that the Estimate per Mode peak memory
can reach X30 times of the Per Node Peak Memory usage.

For example one of the query the estimate was 9GB while the usage was 30GB.

I have 3 questions:

1- Do you think the compute stats will help here?
2- How i can reduce this gap?
3- Does the resource pools based on the Estimate per Mode peak memory? so
if for such query i put the default max memory limit to 5GB, will this
query fail?

Mime
View raw message