Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id EEB56200B38 for ; Fri, 8 Jul 2016 22:43:59 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id ED3C4160A5A; Fri, 8 Jul 2016 20:43:59 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3D1AF160A36 for ; Fri, 8 Jul 2016 22:43:59 +0200 (CEST) Received: (qmail 97856 invoked by uid 500); 8 Jul 2016 20:43:58 -0000 Mailing-List: contact dev-help@asterixdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@asterixdb.apache.org Delivered-To: mailing list dev@asterixdb.apache.org Received: (qmail 97843 invoked by uid 99); 8 Jul 2016 20:43:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jul 2016 20:43:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id AB585186D90 for ; Fri, 8 Jul 2016 20:43:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id clkJH7XwLosW for ; Fri, 8 Jul 2016 20:43:55 +0000 (UTC) Received: from mail-yw0-f169.google.com (mail-yw0-f169.google.com [209.85.161.169]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 86B015F39A for ; Fri, 8 Jul 2016 20:43:55 +0000 (UTC) Received: by mail-yw0-f169.google.com with SMTP id b72so46563914ywa.3 for ; Fri, 08 Jul 2016 13:43:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=wAcRV+yCgSzSQNCJTQQho2gsxtd99bWL7xNuhLcPpp8=; b=No7rQJ2A45XQVn2szC94AJ0X2pwr8DVsIjBFDWNji2pAFZgzuY0Pl3KloUK7ePaqYu vvjagwv3Up1EP4zHCoi1dv31m8EdXFpjTnQWrQO7dgC7mgkau8WNkk5D5DHSIMW/GIcY c1uXfCmecDBPQP4uVADm3O0CVRMPmkSQE5nQ94jyXhqcb/7hv9hYQ+FAAj3ofDI3eAk6 u/9x+VT47HOeeyrnuTu8Re2JsTr5JtBXoi5pXqCLER3zQQnXvjCBt9gEpI0CifftPINF YTrVou3T5hkUSfixRN8KD5MbXsohOvtf1auwnZxvTW5gGYXqXpNj9cidXKwYyuqvcSXD YWyg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=wAcRV+yCgSzSQNCJTQQho2gsxtd99bWL7xNuhLcPpp8=; b=eZaEoUc+iLdF6SAPyHNkD5v/98PatpPD+Lnu1gziEcLcNhBoihzsDyB+uth7/LMXjv 4dsy29r1ug/q/h3VF7iuSxpgGILJzck4OhSlcI3fMWC4T5UkhpZnyODsHjv4rZSNRSnL ooHUhlPUNZuaujLGZl5jM6f3YW2EyD5nX5i5GAZUGmAAC35qzcT+TdY/W70LkXxg32Mt alfBqcpKYjO0aFxGaLs1Ug57Bv8n92xA4Ro5yxF20tS24DUY2M2zkhwHv6+hdpCy2kDt RfiskS2lct1ypeqFXQ9iSBBNXVDYBJqm44OIb3wMj2pAqpRAjnIP1uoyj86/CuHjttSf i1Ew== X-Gm-Message-State: ALyK8tKEsbOBL/aMQJ4KH+QSk460nhwUQRq6fEuSXNnxhnv2sVQt5WncnvP29LdwUSQH+Y4rrmQnEmeKXSiMCA== X-Received: by 10.129.152.68 with SMTP id p65mr5781622ywg.261.1468010634728; Fri, 08 Jul 2016 13:43:54 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.220.144 with HTTP; Fri, 8 Jul 2016 13:43:54 -0700 (PDT) In-Reply-To: References: From: Yingyi Bu Date: Fri, 8 Jul 2016 13:43:54 -0700 Message-ID: Subject: Re: questions about index-only change To: Taewoo Kim Cc: dev@asterixdb.incubator.apache.org Content-Type: multipart/alternative; boundary=94eb2c0ba6ca68e268053725dcd9 archived-at: Fri, 08 Jul 2016 20:44:00 -0000 --94eb2c0ba6ca68e268053725dcd9 Content-Type: text/plain; charset=UTF-8 Cool, thanks a lot, Taewoo! Best, Yingyi On Fri, Jul 8, 2016 at 1:36 PM, Taewoo Kim wrote: > Sure. This is the design docs. There are some changes made and I need to > reflect them. But, these can show the main design. > > Index-only > > https://docs.google.com/presentation/d/1HcoQwaTQu8K2Xdzg46RZP60LqON2oKnWkZx1z1buF1U/edit?usp=sharing > > Limit Push-down > > https://docs.google.com/presentation/d/1lvSLF9j7pcKo2nHkVoiOD9vNSFCNsVDGQYnYCdHhngk/edit?usp=sharing > > Regarding the numbers, I have collected some number in the past using > Pouria's bigFun Benchmark. I have used my version of queries. The result is > not based on the current design. The huge difference is now we are using > instantTryLock, rather than tryLock. But you can still get a sense. > > https://docs.google.com/spreadsheets/d/1YuTuw24TUthr0YhEHMmGr9E4tCYAFxJjlg3S67zRY-M/edit?usp=sharing > > > > > Best, > Taewoo > > On Fri, Jul 8, 2016 at 1:09 PM, Yingyi Bu wrote: > >> Hi Taewoo, >> >> I have a few questions regarding to your index-only change (I'm cc-ing to >> dev just in case more people are interested in the topic.): >> >> 1. Is there any design doc or write up for the index-only change? >> >> 2. Do you have ddls/queries that are designed for the index-only >> performance testing? Do you have some initial performance numbers that >> compare index-only plans and primary-index-access plans? >> >> Thanks! >> >> Yingyi >> >> >> > --94eb2c0ba6ca68e268053725dcd9--