hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <>
Subject [jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb
Date Tue, 22 Jul 2014 07:37:38 GMT


Gopal V updated HIVE-7397:

    Attachment: HIVE-7397.5.patch

Cannot reproduce the tez test failures on my machine.

Re-uploading for a run before commit.

> Set the default threshold for fetch task conversion to 1Gb
> ----------------------------------------------------------
>                 Key: HIVE-7397
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0, 0.13.1
>            Reporter: Gopal V
>            Assignee: Gopal V
>              Labels: Performance
>             Fix For: 0.14.0
>         Attachments: HIVE-7397.1.patch, HIVE-7397.2.patch, HIVE-7397.3.patch, HIVE-7397.4.patch.txt,
> Currently, modifying the value of hive.fetch.task.conversion to "more" results in a dangerous
setting where small scale queries function, but large scale queries crash.
> This occurs because the default threshold of -1 means apply this optimization for a petabyte
> I am testing a variety of queries with the setting "more" (to make it the default option
as suggested by HIVE-887) change the default threshold for this feature to a reasonable 1Gb.

This message was sent by Atlassian JIRA

View raw message