Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 43E31200C5E for ; Fri, 7 Apr 2017 21:29:47 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 42792160B84; Fri, 7 Apr 2017 19:29:47 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8A14D160B97 for ; Fri, 7 Apr 2017 21:29:46 +0200 (CEST) Received: (qmail 97379 invoked by uid 500); 7 Apr 2017 19:29:45 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 97356 invoked by uid 99); 7 Apr 2017 19:29:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Apr 2017 19:29:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id AD1BFC05D7 for ; Fri, 7 Apr 2017 19:29:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id OGScxmIYCEqx for ; Fri, 7 Apr 2017 19:29:43 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 858835F1B3 for ; Fri, 7 Apr 2017 19:29:42 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id D068AE0A6C for ; Fri, 7 Apr 2017 19:29:41 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 884B724067 for ; Fri, 7 Apr 2017 19:29:41 +0000 (UTC) Date: Fri, 7 Apr 2017 19:29:41 +0000 (UTC) From: "Mark Wagner (JIRA)" To: dev@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HIVE-16408) SchemaToTypeInfo in AvroSerde makes many calls to synchronized functions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 07 Apr 2017 19:29:47 -0000 Mark Wagner created HIVE-16408: ---------------------------------- Summary: SchemaToTypeInfo in AvroSerde makes many calls to synchronized functions Key: HIVE-16408 URL: https://issues.apache.org/jira/browse/HIVE-16408 Project: Hive Issue Type: Bug Components: Serializers/Deserializers Reporter: Mark Wagner The generateTypeInfo method uses schema.getProp and schema.getJsonProp to retrieve metadata from the Avro schema. Both of those methods result in synchronization on the schema. generateTypeInfo is being called for every nullable field in every record, which makes it a significant bottleneck in multi-threaded use. -- This message was sent by Atlassian JIRA (v6.3.15#6346)