From dev-return-24380-archive-asf-public=cust-asf.ponee.io@atlas.apache.org Mon Jun 4 15:52:44 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 89A53180636 for ; Mon, 4 Jun 2018 15:52:43 +0200 (CEST) Received: (qmail 9616 invoked by uid 500); 4 Jun 2018 13:52:42 -0000 Mailing-List: contact dev-help@atlas.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@atlas.apache.org Delivered-To: mailing list dev@atlas.apache.org Received: (qmail 9598 invoked by uid 99); 4 Jun 2018 13:52:41 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Jun 2018 13:52:41 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 51D731A0554 for ; Mon, 4 Jun 2018 13:52:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.899 X-Spam-Level: * X-Spam-Status: No, score=1.899 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=civitaslearning.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id DqAPztJcduOs for ; Mon, 4 Jun 2018 13:52:38 +0000 (UTC) Received: from mail-qk0-f181.google.com (mail-qk0-f181.google.com [209.85.220.181]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 3D4925F24A for ; Mon, 4 Jun 2018 13:52:38 +0000 (UTC) Received: by mail-qk0-f181.google.com with SMTP id y4-v6so6799386qka.5 for ; Mon, 04 Jun 2018 06:52:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=civitaslearning.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=1zuHiaIKZodnZKUzC3vLIrtkSLonnDEvPwa+HjnIpVk=; b=dh/eB65q/wmKqIXI2QZUfGB0XBdcC4wC9EHQ+b5RGuNEc9F3jYSk5294VSYHZeu5n5 Er+bINGgNVFj87o0lhLeky66/j8g17DY2LUOcHBDJ+AEp938gT0op9G4sGXam7rYTQP2 GiBe7Jbm+5ZG0sSf5NvR7jMQc9MC15vsvotXg= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=1zuHiaIKZodnZKUzC3vLIrtkSLonnDEvPwa+HjnIpVk=; b=aLVpbiIyHoKK+2Bc2zxSHzix92WJ4VYt2MriKshqfFzK4PW83fH+8MnyuRvtSVySrq TIcc3JoHl2NXt7jfzQS9ws+5hi0QGARkd7TNys0sfBu99miitMzc81qN9y2rYtGyMq+d DkfpAyvyIo858tncQUBekm0Yxsd26TUJ3DLl5LlkLQyBqDwKF2kG2d9BiDc3tDdD7qPR gQuKZaCF8r92qJK6Pl4ibBnMC3fbvOJv1XcwAM+Jjeb3zPOQzblI45zWZMb6eAW8xXce h7olTdI5TIY7zgjGRyffdJAR3TFZqVAbMB5WU0vIqhymZdIvICTDxSMC8HzkZHONHjsG oySg== X-Gm-Message-State: APt69E11PqAuXmtj95wHBHB2V197Ii4YHlNbsEr6Mv+tzrcLW5VvMwOQ 0LzDFk6jo/F66zS4zqiwhqE+dCEsRlqVj8BdGgZNTRhCRLg= X-Google-Smtp-Source: ADUXVKL9nS6/QDChaLVoGEQx553+Hg5WKu8qCIR1kFQuiIgE9OxV+EdcaQGv+qTQQnDs6OFo9jrUidcsJuE96IrRa08= X-Received: by 2002:ae9:d60a:: with SMTP id r10-v6mr19319675qkk.303.1528120351892; Mon, 04 Jun 2018 06:52:31 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ac8:3fe2:0:0:0:0:0 with HTTP; Mon, 4 Jun 2018 06:52:31 -0700 (PDT) In-Reply-To: <12AF878D-67DE-44F6-A678-2BA525CD3D87@hortonworks.com> References: <12AF878D-67DE-44F6-A678-2BA525CD3D87@hortonworks.com> From: Pierre Padovani Date: Mon, 4 Jun 2018 08:52:31 -0500 Message-ID: Subject: Re: Performance of relationships To: dev@atlas.apache.org Content-Type: multipart/alternative; boundary="000000000000bfbca0056dd13e09" --000000000000bfbca0056dd13e09 Content-Type: text/plain; charset="UTF-8" Here is the raw data: child count v2 post v2 get container v1 post v1 get container v2 hybrid post v2 hybrid get 0 210 85 96 478 487 185 1 188 83 129 140 213 75 2 177 83 209 357 188 118 3 162 78 117 72 387 323 4 188 92 324 71 360 169 5 166 80 453 100 314 299 6 188 87 364 79 332 154 7 152 69 174 341 282 244 8 168 67 252 318 184 172 9 201 88 404 102 192 235 10 144 88 169 253 313 380 11 234 81 261 419 270 185 12 177 67 366 99 197 259 13 146 76 167 259 176 270 14 179 87 187 80 267 352 15 273 105 255 82 161 276 16 159 64 199 246 176 291 17 173 84 190 110 125 389 18 187 99 422 194 171 324 19 158 84 320 389 192 442 20 179 94 339 92 225 410 21 193 211 221 89 185 301 22 233 77 375 97 166 284 23 247 103 244 124 190 463 24 172 159 459 119 150 256 25 181 102 385 85 279 443 26 188 93 290 99 137 326 27 169 88 577 277 171 423 28 192 82 345 143 121 355 29 253 88 497 190 205 406 30 232 81 287 288 119 396 31 178 89 393 263 219 441 32 208 75 400 166 148 528 33 147 83 366 152 160 451 34 179 98 322 193 121 452 35 166 77 331 184 126 464 36 348 69 526 161 140 468 37 164 85 322 164 121 443 38 166 93 349 162 128 534 39 184 83 504 152 152 459 40 179 234 666 156 179 469 41 188 86 661 154 138 558 42 180 72 666 157 114 461 43 171 87 663 184 127 557 44 189 91 532 211 147 474 45 202 93 712 156 140 464 46 341 79 662 162 103 541 47 206 101 658 184 102 535 48 153 85 634 173 149 552 49 374 164 648 187 141 674 50 193 72 638 169 142 568 51 149 92 643 177 137 681 52 213 105 642 167 176 580 53 195 127 653 240 121 498 54 152 74 579 235 109 592 55 165 81 584 223 150 616 56 190 107 595 241 113 586 57 375 74 667 268 137 560 58 256 128 701 248 151 621 59 140 81 624 235 141 580 60 164 92 701 236 133 599 61 181 110 991 252 186 646 62 396 88 980 190 129 617 63 220 147 630 202 158 690 64 164 78 920 232 215 847 65 230 196 652 241 147 580 66 192 89 27 253 141 759 67 230 152 975 212 119 641 68 149 90 14 196 132 627 69 167 231 866 243 142 647 70 160 98 153 247 116 666 71 204 137 980 278 150 679 72 142 81 791 268 168 648 73 209 165 122 241 147 703 74 172 77 939 194 132 595 75 145 80 81 209 154 690 76 134 91 25 261 119 913 77 151 77 962 241 129 799 78 139 75 54 261 101 746 79 151 95 904 453 121 672 80 131 78 184 252 150 741 81 142 82 26 268 109 745 82 170 74 963 261 165 658 83 157 78 970 263 191 778 84 329 78 320 309 112 756 85 136 78 326 314 114 734 86 140 89 324 306 136 722 87 144 186 339 321 117 671 88 164 76 316 307 110 792 89 154 81 326 327 127 820 90 143 77 315 267 114 743 91 156 94 19 272 137 772 92 137 184 152 312 116 868 93 214 136 127 329 83 815 94 136 78 301 324 114 819 95 131 77 158 342 116 741 96 144 77 210 331 155 824 97 144 84 556 324 95 862 98 191 134 257 284 120 862 99 143 80 492 340 117 879 On Fri, Jun 1, 2018 at 3:48 PM, Apoorv Naik wrote: > Can you share the text of the benchmarks you performed ? My email is not > rendering the attached image. > > From: Pierre Padovani > Reply-To: "dev@atlas.apache.org" > Date: Friday, June 1, 2018 at 12:49 PM > To: "dev@atlas.apache.org" > Subject: Re: Performance of relationships > > I was in a hurry writing the previous email and realized that I did not > specify that the relationship type was COMPOSITION. > > On Fri, Jun 1, 2018 at 2:37 PM, Pierre Padovani civitaslearning.com> wrote: > All, > > I decided to spend a few cycles performing from basic performance tests to > help us refine our type system. The goal was to determine how we would add > relationships to our entities and if we would use the new relationship APIs > or not. The test was simple. I created a type called container and a type > called child both extending DataSet. I think created an instance of > container, and added one child at a time to the container recording the > cost of the add, and the cost of fetching the container after each add. > > There were three tests run: > > - Legacy - Assign the entities to the attributes in the attribute map > - Hybrid - Leave the legacy attributes in the type system, and use the > relationship APIs > - V2 - Remove the legacy attributes and use the relationship APIs > > Here are the results for 100 children: > > [cid:ii_jhwdc79w0_163bcd934880f531] > > Is there a reason we are continuing to use legacy attributes in the type > system(s) we are shipping with Atlas? From a performance perspective this > does not seem like a reasonable thing to do. > > Thanks! > > Pierre > > > --000000000000bfbca0056dd13e09--