Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 496AD200C69 for ; Fri, 21 Apr 2017 23:14:14 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 481A5160B86; Fri, 21 Apr 2017 21:14:14 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 99367160B97 for ; Fri, 21 Apr 2017 23:14:13 +0200 (CEST) Received: (qmail 92477 invoked by uid 500); 21 Apr 2017 21:14:12 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 92267 invoked by uid 99); 21 Apr 2017 21:14:12 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Apr 2017 21:14:12 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 48F61C0349 for ; Fri, 21 Apr 2017 21:14:12 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id YTE4sdY9GZ7H for ; Fri, 21 Apr 2017 21:14:11 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 5FBC05F39D for ; Fri, 21 Apr 2017 21:14:11 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 4F01DE0D87 for ; Fri, 21 Apr 2017 21:14:05 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 8563824007 for ; Fri, 21 Apr 2017 21:14:04 +0000 (UTC) Date: Fri, 21 Apr 2017 21:14:04 +0000 (UTC) From: "Sergey Shelukhin (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-15665) LLAP: OrcFileMetadata objects in cache can impact heap usage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 21 Apr 2017 21:14:14 -0000 [ https://issues.apache.org/jira/browse/HIVE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15665: ------------------------------------ Attachment: HIVE-15665.wo.16233.patch HIVE-15665.patch Rebased the patch on top of HIVE-16233. Also including the path with both for a test run, this is still broken iirc > LLAP: OrcFileMetadata objects in cache can impact heap usage > ------------------------------------------------------------ > > Key: HIVE-15665 > URL: https://issues.apache.org/jira/browse/HIVE-15665 > Project: Hive > Issue Type: Improvement > Components: llap > Reporter: Rajesh Balamohan > Assignee: Sergey Shelukhin > Attachments: HIVE-15665.04.patch, HIVE-15665.patch, HIVE-15665.wo.16233.patch > > > OrcFileMetadata internally has filestats, stripestats etc which are allocated in heap. On large data sets, this could have an impact on the heap usage and the memory usage by different executors in LLAP. -- This message was sent by Atlassian JIRA (v6.3.15#6346)