Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CE70817A31 for ; Fri, 22 May 2015 05:19:17 +0000 (UTC) Received: (qmail 8780 invoked by uid 500); 22 May 2015 05:19:17 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 8644 invoked by uid 500); 22 May 2015 05:19:17 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 8459 invoked by uid 99); 22 May 2015 05:19:17 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 May 2015 05:19:17 +0000 Date: Fri, 22 May 2015 05:19:17 +0000 (UTC) From: "Mostafa Mokhtar (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-10711: ----------------------------------- Attachment: HIVE-10711.4.patch Addressing feedback comments. > Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem > ------------------------------------------------------------------------------------------------------------------------------------------ > > Key: HIVE-10711 > URL: https://issues.apache.org/jira/browse/HIVE-10711 > Project: Hive > Issue Type: Bug > Reporter: Jason Dere > Assignee: Mostafa Mokhtar > Fix For: 1.2.1 > > Attachments: HIVE-10711.1.patch, HIVE-10711.2.patch, HIVE-10711.3.patch, HIVE-10711.4.patch > > > Tez HashTableLoader bases its memory allocation on HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD. If this value is largeer than the process max memory then this can result in the HashTableLoader trying to use more memory than available to the process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)