Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1AD9C200C4D for ; Wed, 5 Apr 2017 18:42:32 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 198B0160B94; Wed, 5 Apr 2017 16:42:32 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6041B160B76 for ; Wed, 5 Apr 2017 18:42:31 +0200 (CEST) Received: (qmail 10055 invoked by uid 500); 5 Apr 2017 16:42:30 -0000 Mailing-List: contact dev-help@geode.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@geode.apache.org Delivered-To: mailing list dev@geode.apache.org Received: (qmail 10043 invoked by uid 99); 5 Apr 2017 16:42:30 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Apr 2017 16:42:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id BD4A1C6796 for ; Wed, 5 Apr 2017 16:42:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.481 X-Spam-Level: ** X-Spam-Status: No, score=2.481 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=pivotal-io.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id tc9diGQeiSJm for ; Wed, 5 Apr 2017 16:42:27 +0000 (UTC) Received: from mail-oi0-f49.google.com (mail-oi0-f49.google.com [209.85.218.49]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C4E285F295 for ; Wed, 5 Apr 2017 16:42:26 +0000 (UTC) Received: by mail-oi0-f49.google.com with SMTP id b187so22168344oif.0 for ; Wed, 05 Apr 2017 09:42:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pivotal-io.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=yzksnHrNsoXtf6SQI2MFDIcaJCM7MxCwr2Sc/rgqoho=; b=C7RZd/qdxf6MXCnahdGCUXSdChmAK/Oi4AurLM+PMyE7k+uTMwTfSCkp1UQw+O0J9z knximBOLRFg5JwXgqGSIiNqQwgewcjzaHdRazCmWecrOWdg0D5lxKtob/XDLZn5MoCUO pPaRHGBeo+E9cFC2EDiJ5XhdBFPrNfhTYy1Ym85jGqXvsFfg0Yq1DuTMgk2bfO6RsXOM mVdukwd19iEC3cVzBJbHkvIvtawA4VJeVGz2wTljN+oqbg/9dCCpNQ9b1j+x7hYA0axe Tmq+HfFi50hrGtMvKOnVSpfm8okmhfncsxswr0s5iQiN5ZVmJ3lBF+NmOrFj04ompdYF QVKw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=yzksnHrNsoXtf6SQI2MFDIcaJCM7MxCwr2Sc/rgqoho=; b=nlzx8GXlcKKDUKEqOF0nfgCC7t8qan3A0QOaEr4KH9nsHg7wnxvDDzDHaQ31HO1Iv+ kSfEgtuHLHI9OI/WWtm4+v+Q8PKcaMsmUGD8W9rog3FQm4RTKbpj+Jp+2JeadQ8UiIy8 eQb34+BCvC9zLaMUDR4MIXj/fXjY2Tm5cuvigc7OLekqlWHbUtdEOXYF3oAR33kk4k6P KU5qC3zw1xVT8x7DJH0BoRnpUKR89fwideYGnC4MD22lrzyTMhLgTImqZiMsOwGBHVgo z8/fnUO7Xtp/mSjuoDni1MkIKdL7aNSAKx+/dc0SimJwJoZWaESaWyqIS9MeEarKTzWr fNyw== X-Gm-Message-State: AFeK/H2PyqVrH4OqSyBoEi68FwXuDnaVUVCH0nYuWfhvcrSr0jXL9dgvs2ZnijDDhoJymZ/7f5kyYmyJe/5PFOAy X-Received: by 10.202.241.138 with SMTP id p132mr10180892oih.39.1491410539590; Wed, 05 Apr 2017 09:42:19 -0700 (PDT) MIME-Version: 1.0 Received: by 10.74.117.72 with HTTP; Wed, 5 Apr 2017 09:42:19 -0700 (PDT) In-Reply-To: References: From: Michael Stolz Date: Wed, 5 Apr 2017 12:42:19 -0400 Message-ID: Subject: Re: Global PDX Types -> Move to Region Level? To: dev@geode.apache.org Content-Type: multipart/alternative; boundary=94eb2c092f666d4d43054c6e13cd archived-at: Wed, 05 Apr 2017 16:42:32 -0000 --94eb2c092f666d4d43054c6e13cd Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable There's nothing to prevent putting the same object into multiple regions. The type catalog for a database shouldn't be relative to a table. It should be database wide. The real problem in this case is the proliferation of PDX Types caused by using JSON documents that have only some of their fields populated, and have their fields in arbitrary orders. The documents in the particular case studied really are intended to all be the same type, but it's difficult to tell because they are structurally mutated in so many ways. It might be possible to make Geode figure out that they are all the same type, but the real best-practice here is make sure you structure your JSON documents consistently so that Geode can know that they are all of the same type. Don't leave fields empty, default them to null or zero. Don't change the order of the fields. This behavioral change will make the JSON documents as structured as the Java Objects representing the same data would be. Geode doesn't have PDXtype explosion with Java Objects. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Wed, Apr 5, 2017 at 5:51 AM, Olivier Mallassi wrote: > I do not know about the negative impact but could you elaborate about th= e > DLock? > > thx. > > On Fri, Mar 31, 2017 at 7:48 PM, Real Wes wrote: > > > > > Would there be a negative impact in moving PDXType=E2=80=99s to the reg= ion level > > instead of the cache level? On the positive side, when there is an > object > > with a variable number of fields being stored in a partitioned region, = we > > would get rid of the distributed lock. As it is now at the cache level= , > a > > DLock is made, slowing performance. Another positive is that export > would > > go much, much, much faster in systems with a lot of PDXType=E2=80=99s b= ecause all > > PDXType=E2=80=99s are exported with every region. > > > > Thanks, > > Wes > > > > > --94eb2c092f666d4d43054c6e13cd--