Return-Path: X-Original-To: apmail-incubator-drill-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-drill-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DE726E446 for ; Thu, 6 Dec 2012 19:18:43 +0000 (UTC) Received: (qmail 41068 invoked by uid 500); 6 Dec 2012 19:18:43 -0000 Delivered-To: apmail-incubator-drill-user-archive@incubator.apache.org Received: (qmail 40989 invoked by uid 500); 6 Dec 2012 19:18:43 -0000 Mailing-List: contact drill-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: drill-user@incubator.apache.org Delivered-To: mailing list drill-user@incubator.apache.org Received: (qmail 40980 invoked by uid 99); 6 Dec 2012 19:18:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Dec 2012 19:18:43 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.217.175] (HELO mail-lb0-f175.google.com) (209.85.217.175) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Dec 2012 19:18:36 +0000 Received: by mail-lb0-f175.google.com with SMTP id gg13so5164194lbb.6 for ; Thu, 06 Dec 2012 11:18:15 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=A4U8B57n3a0WG2M3sKoWh93yKmWrQDWiFRMC11CzEGY=; b=RBvAwC4c3Qg3FzrV/g7Bx2kieuFkWL5tiIWb5uwBP8Ht7MWUxKzfhG1w319LrC56Bc Kz+GxnqHrSaPyZG2zGM1M1DBsdedSlxTtJypSB5wke2nracheNmAbdUpx1dG+Y6m5lMB CJOrW43a0Rn78yEoAdO3W6hpRgDUlecD0ShiDgMz0ah2c8KwcDNf39tapEkIbV1hZK0s cwp7Q4xa11S2+HQzYm9mQsLLsqarbb9k2xdbYI8PtuPqMatZLeeBBcp8X0rOd4E8WXa9 GcbX/K4GmPQ1WFbTFKpW2HTW67uEWSS4kw5xSKDnMmUEiJ/sy2h8rwqGCAT0lTfNGafG nXMw== Received: by 10.152.106.79 with SMTP id gs15mr2941090lab.31.1354821494000; Thu, 06 Dec 2012 11:18:14 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.19.68 with HTTP; Thu, 6 Dec 2012 11:17:53 -0800 (PST) In-Reply-To: <59CB5FA4-9982-42B4-87FE-CB527197379C@falconknight.com> References: <59CB5FA4-9982-42B4-87FE-CB527197379C@falconknight.com> From: Tomer Shiran Date: Thu, 6 Dec 2012 11:17:53 -0800 Message-ID: Subject: Re: What do you want out of Apache Drill? To: drill-user@incubator.apache.org Content-Type: multipart/alternative; boundary=f46d04083f3be24a3f04d033f516 X-Gm-Message-State: ALoCoQmONfMpSja84QjGmGcKUqb88BqBtKdV2LnZJxOIPkAwhHBvLlxp5EmxgLQGrnJcg13L4mK4 X-Virus-Checked: Checked by ClamAV on apache.org --f46d04083f3be24a3f04d033f516 Content-Type: text/plain; charset=ISO-8859-1 Thanks Shawn! It looks like the attachment is being removed by the Apache mailing list. Can you paste the query in the body or put it in a publicly accessible place (Dropbox, Google Doc, etc.)? Thanks! On Thu, Dec 6, 2012 at 10:57 AM, Shawn O'Connor wrote: > Once it is ready, I'd like to replace our traditional SQL servers with > Drill. Our use case is realtime statistical analytics (Average, standard > deviation, sum, etc.) on user specified groups of data. > > Our traditional SQL solution works okay up to about 300k rows but starts > to become slow (> 3 seconds) beyond that. We've worked around it by having > multiple SQL servers and sending the queries to them asynchronously, > collecting the varied responses and then returning the results. We need to > be able to handle 12 million rows, still hopefully in a real-time manner. > In addition, the drill approach would shift the complexity from the > sharding data. > > I've attached a sample query as an attachment. > > -Shawn > > > > > On Dec 6, 2012, at 10:36 AM, Jacques Nadeau > wrote: > > > > While comments like "Faster Hive" or "more compliant SQL" are useful, it > > would be more helpful if you spent more time describing the particular > data > > flows that you run today (including data sources), what your pain points > > are and things that you can't do today but would like to do. > > > -- Tomer Shiran Director of Product Management | MapR Technologies | 650-804-8657 --f46d04083f3be24a3f04d033f516--