Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Message-ID: <8985946.145571292448122116.JavaMail.jira@thor>
Date: Wed, 15 Dec 2010 16:22:02 -0500 (EST)
From: "Ning Zhang (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Subject: [jira] Updated: (HIVE-1806) The merge criteria on dynamic partitons
 should be per partiton
In-Reply-To: <18222401.268461290540193656.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HIVE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-1806:
-----------------------------

    Attachment: HIVE-1806.patch

> The merge criteria on dynamic partitons should be per partiton
> --------------------------------------------------------------
>
>                 Key: HIVE-1806
>                 URL: https://issues.apache.org/jira/browse/HIVE-1806
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1806.patch
>
>
> Currently the criteria of whether a merge job should be fired on dynamic generated partitions are is the average file size of files across all dynamic partitions. It is very common that some dynamic partitions contains mostly large files and some contains mostly small files. Even though the average size of the total files are larger than the hive.merge.smallfiles.avgsize, we should merge those partitions containing small files only. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.