Return-Path: Delivered-To: apmail-hadoop-hive-user-archive@minotaur.apache.org Received: (qmail 25832 invoked from network); 11 Sep 2009 00:56:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 11 Sep 2009 00:56:29 -0000 Received: (qmail 42168 invoked by uid 500); 11 Sep 2009 00:56:29 -0000 Delivered-To: apmail-hadoop-hive-user-archive@hadoop.apache.org Received: (qmail 42134 invoked by uid 500); 11 Sep 2009 00:56:29 -0000 Mailing-List: contact hive-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-user@hadoop.apache.org Delivered-To: mailing list hive-user@hadoop.apache.org Received: (qmail 42125 invoked by uid 99); 11 Sep 2009 00:56:29 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Sep 2009 00:56:29 +0000 X-ASF-Spam-Status: No, hits=-1.4 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS,SUBJECT_FUZZY_TION X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of njain@facebook.com designates 69.63.179.25 as permitted sender) Received: from [69.63.179.25] (HELO mailout-sf2p.facebook.com) (69.63.179.25) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Sep 2009 00:56:19 +0000 Received: from mail.thefacebook.com (intlb01.snat.snc1.facebook.com [10.128.203.18] (may be forged)) by pp02.snc1.tfbnw.net (8.14.1/8.14.1) with ESMTP id n8B0th7u006617 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NOT) for ; Thu, 10 Sep 2009 17:55:43 -0700 Received: from SC-MBXC1.TheFacebook.com ([192.168.18.100]) by sc-hub01.TheFacebook.com ([192.168.18.104]) with mapi; Thu, 10 Sep 2009 17:55:56 -0700 From: Namit Jain To: "hive-user@hadoop.apache.org" Date: Thu, 10 Sep 2009 17:55:54 -0700 Subject: RE: enforcing query with partition column Thread-Topic: enforcing query with partition column Thread-Index: AcoyR62b0PNIr2nISGaJpgv5+ekLWgAMuVcQ Message-ID: References: <91a4cb30909081006p78f52271tbb038d028dd47f54@mail.gmail.com> <91a4cb30909101150i1883f588nb70bfcb5d443bef@mail.gmail.com> In-Reply-To: <91a4cb30909101150i1883f588nb70bfcb5d443bef@mail.gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_DFD95197F3AE8C45B0A96C2F4BA3A2556C90955D7ESCMBXC1TheFac_" MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=1.12.8161:2.4.5,1.2.40,4.0.166 definitions=2009-09-11_01:2009-09-01,2009-09-10,2009-09-10 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 ipscore=0 phishscore=0 bulkscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx engine=5.0.0-0908210000 definitions=main-0909100158 X-Virus-Checked: Checked by ClamAV on apache.org --_000_DFD95197F3AE8C45B0A96C2F4BA3A2556C90955D7ESCMBXC1TheFac_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable That should work - which revision of hive are you using ? From: Abhijit Pol [mailto:apol@rocketfuelinc.com] Sent: Thursday, September 10, 2009 11:51 AM To: hive-user@hadoop.apache.org Subject: Re: enforcing query with partition column Thanks Namit. Setting this parameter in general works. However following qu= ery is now not allowed: SELECT a.bar FROM ( SELECT b.bar FROM table1 b WHERE b.partition_key =3D 1 UNION ALL SELECT c.bar FROM table2 c WHERE c.partition_key =3D 1 ) a Individual sub queries are allowed here...any suggestions? On Tue, Sep 8, 2009 at 10:22 AM, Namit Jain > wrote: If you run in strict mode, that is enforced. set hive.mapred.mode=3Dstrict -namit -----Original Message----- From: Abhijit Pol [mailto:apol@rocketfuelinc.com] Sent: Tuesday, September 08, 2009 10:07 AM To: hive-user@hadoop.apache.org Subject: enforcing query with partition column Is there a way in hive to enforce use of partition column before accepting the query for execution? Often user make mistake and don't specify them and then end-up waiting a lot more than expected.... Thanks, Abhi --_000_DFD95197F3AE8C45B0A96C2F4BA3A2556C90955D7ESCMBXC1TheFac_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

That should work – which revision of hive are you usin= g ?

 

 

From: Abhijit Pol [mailto:apol@rocketfuelinc.com]
Sent: Thursday, September 10, 2009 11:51 AM
To: hive-user@hadoop.apache.org
Subject: Re: enforcing query with partition column=

 

Thanks Namit. Setting t= his parameter in general works. However following query is now not allowed:

SELECT a.bar FROM
(
SELECT b.bar FROM table1 b WHERE b.partition_key =3D 1
UNION ALL
SELECT c.bar FROM table2 c WHERE c.partition_key =3D 1
) a

Individual sub queries are allowed here...any suggestions?

On Tue, Sep 8, 2009 at 10:22 AM, Namit Jain <njain@facebook.com> wrote:

If you run in strict mode, that is enforced.

set hive.mapred.mode=3Dstrict



-namit



-----Original Message-----
From: Abhijit Pol [mailto:apol@ro= cketfuelinc.com]
Sent: Tuesday, September 08, 2009 10:07 AM
To: hive-user@hadoop.apache.= org
Subject: enforcing query with partition column

Is there a way in hive to enforce use of partition column before
accepting the query for execution?
Often user make mistake and don't specify them and then end-up waiting
a lot more than expected....

Thanks,
Abhi

 

--_000_DFD95197F3AE8C45B0A96C2F4BA3A2556C90955D7ESCMBXC1TheFac_--