hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopal Vijayaraghavan <gop...@apache.org>
Subject Re: limit clause + fetch optimization
Date Wed, 22 Jul 2015 17:30:36 GMT
Hi,

> For your first offer of testing a patch, unfortunately we tend to run
>our production software on customers' Hadoop clusters, so we can't easily
>patch their Hive instances.  But I'll still take you up on that if I find
>some time to try it.

No worries, I¹ll get to a patch sooner or later. For now, as a workaround
to your problem, you can set your fetch task conversion threshold to a
high value.

hive.fetch.task.conversion.threshold


That¹s set to 1Gb by default, which is the input size threshold at which
point it goes and runs a cluster job.

Cheers,
Gopal







Mime
View raw message