impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeszy <jes...@gmail.com>
Subject Re: HDFS timeout setting
Date Sat, 09 Sep 2017 06:41:19 GMT
Hello Nasron,

The read hanging is an HDFS timeout issue, to work around it you would
need an HDFS version which has HADOOP-12672. After that, you should be
able to set ipc.client.rpc-timeout.ms to a reasonable value in
Impala's HDFS client settings.

HTH

On 8 September 2017 at 20:24, Nasron Cheong <nasron.cheong@upsight.com> wrote:
> We encountered an issue where our hdfs cluster misbehaved, which resulted in
> very slow reads. However, existing impala queries would continue even if
> cancelled, presumably being blocked by the hdfs read.
>
> Are there settings to be less aggressive on hdfs reads so we can fail more
> quickly if hdfs is the issue?
>
> Thanks.
>
> - Nasron

Mime
View raw message