impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Petter von Dolwitz (Hem)" <petter.von.dolw...@gmail.com>
Subject Re: Impala daemon memory
Date Thu, 17 Aug 2017 13:54:43 GMT
Hi,

could it be related to data locality, i.e if you use HDFS with replication
factor 3? You could check this by increasing the replication factor to 6
for the files you use and see if there is a change.

Br,
Petter

Den 17 aug. 2017 11:57 fm skrev "Alexander Shoshin" <
Alexander_Shoshin@epam.com>:

> Hi, team!
>
>
>
> I have an issue working with impala. Maybe you could help me?
>
>
>
> My data is stored in parquet files. I am running queries to the data on
> Impala through JMeter. I have 6 Impala daemons and JMeter sends queries
> randomly to each of them.
>
> The problem is that only 3 of 6 Impala daemons use all available memory.
> Others 3 Impala daemons use 3-4 times less memory.
>
>
>
> These 3 daemons each time are different, but there are always 3 of them.
> When I tried to disable 2 daemons I saw the same picture: 3 daemons used
> all available memory and 1 daemon not. All Impala daemons have the same
> mem_limit setting.
>
>
>
> Have you ever had such strange behavior? Why not all Impala daemons use
> all available memory?
>
>
>
> Regards,
>
> Alexander Shoshin
>
>
>

Mime
View raw message