Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9BE4B19403 for ; Sat, 9 Apr 2016 00:53:54 +0000 (UTC) Received: (qmail 38836 invoked by uid 500); 9 Apr 2016 00:53:53 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 38764 invoked by uid 500); 9 Apr 2016 00:53:53 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 38754 invoked by uid 99); 9 Apr 2016 00:53:53 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Apr 2016 00:53:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id A2EBC1A062B for ; Sat, 9 Apr 2016 00:53:52 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.198 X-Spam-Level: * X-Spam-Status: No, score=1.198 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id kl_rX_g3eu_P for ; Sat, 9 Apr 2016 00:53:51 +0000 (UTC) Received: from mail-io0-f177.google.com (mail-io0-f177.google.com [209.85.223.177]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 94CDC5F39A for ; Sat, 9 Apr 2016 00:53:51 +0000 (UTC) Received: by mail-io0-f177.google.com with SMTP id o126so128356611iod.0 for ; Fri, 08 Apr 2016 17:53:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to; bh=/2g3roul9BFq01guHCj1WxAuqL7zpsnyW5iYCL8vXDA=; b=v1twNuOnQHAqb8IyzyvchHTZwiiE7XkT3SQQ0T5yCXQqUVmMx0+VYZbEz4OwOLqlCZ WSplFirZS2O+t5hgrvf1ezMJyM4MWFMBeIk9lU5xx3yDOBsL5JG1cBTMkLtgJ6vmKwij IJrcbOOOWRBPAXL8NAoWGAFGPAw0OzUh1TqddmLMbhgl5Frf3NwJNPtKAWKI/4ItbJ1U d6X7O532ORw1xIKDPoI8EgWpcrfO51U2o77t+5KRwNlQNcu35HANrbNijwy5+fiqzcAz /Mrid2AymEjVyHv641Iq0CSSjboZdTWm24txPQzptcA59FO7hGVPZPGqPA6N0o7m66YU gt3w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=/2g3roul9BFq01guHCj1WxAuqL7zpsnyW5iYCL8vXDA=; b=VuAPFJaTW1YzMoAP9xLe0imC061qdUtWt65tCAHB5/4QVtX19nmCQ9uLjZcAV7eP0V 6zTqH+nV/vbDj1YsHp1FSDiexcgmlgOoFBkqE7aMyKRTPlVGOSjlDv6dx1q4Xa6nXPbV 5VwFBXHOzO5meDothlfuJkKnzsaN8EPkopfiOXxdVJGdbHB33YidFtBtAq1GeXPCa+zG jc/OF2ec+LWyOOQiR6wW8YdS3gELJ90PJLvjdGD3tu7MMMhaPW6cWC8Zx0xHT4+JQbHe dzVBF/TXfXPXOiPaPMO/wcqaFbQlFVA54eqCHBVVtZpCzKXdBX5SKjj4fuecABYEpImW qjSg== X-Gm-Message-State: AD7BkJLh2oUF/LFgtfCbi34T5mJ1xYEj/oV/usFnfig1ngUA6GEC4/BH7urTlAtZGvqd9apVWGi1aC0e9ERuiA== MIME-Version: 1.0 X-Received: by 10.107.134.148 with SMTP id q20mr11963027ioi.92.1460163231004; Fri, 08 Apr 2016 17:53:51 -0700 (PDT) Received: by 10.107.129.25 with HTTP; Fri, 8 Apr 2016 17:53:50 -0700 (PDT) Date: Fri, 8 Apr 2016 17:53:50 -0700 Message-ID: Subject: ORC file sort order .. From: Gautam To: user@hive.apache.org Content-Type: multipart/alternative; boundary=001a113eae1ab2c50f053002be76 --001a113eae1ab2c50f053002be76 Content-Type: text/plain; charset=UTF-8 Hey, This might be too obvious a question but I haven't found a way to validate ordering in an ORC file. I need each file to be ordered by a column, Is there a sure shot way of ensuring the sort order in an ORC file is as I expect it? The closest i'v come to is using the hive --orcfiledump --rowindex which prints that columns min/max values in the index. But that is still not saying if the data within the stripes is sorted. Cheers, -Gautam. --001a113eae1ab2c50f053002be76 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hey,

=C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0This might be too obvious a question but I haven't= found a way to validate ordering in an ORC file. I need each file to be or= dered by a column, Is there a sure shot way of ensuring the sort order in a= n ORC file is as I expect it?

The closest i'v come to is using the hi= ve --orcfiledump --rowindex <col_id> which prints that columns min/ma= x values in the index. But that is still not saying if the data within the = stripes is sorted.

Cheers,
-Gautam.
--001a113eae1ab2c50f053002be76--