Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2A46A10C62 for ; Wed, 4 Dec 2013 18:51:08 +0000 (UTC) Received: (qmail 64545 invoked by uid 500); 4 Dec 2013 18:51:06 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 64476 invoked by uid 500); 4 Dec 2013 18:51:06 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 64468 invoked by uid 99); 4 Dec 2013 18:51:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Dec 2013 18:51:06 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of thelabdude@gmail.com designates 209.85.128.169 as permitted sender) Received: from [209.85.128.169] (HELO mail-ve0-f169.google.com) (209.85.128.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Dec 2013 18:51:00 +0000 Received: by mail-ve0-f169.google.com with SMTP id c14so12806539vea.0 for ; Wed, 04 Dec 2013 10:50:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=zR2OpJli9NLqk857sqzD1KHMYMWaWUbAlu0bGuHzOlY=; b=VDO/unK3HA/118Er/Htlx87RfZeYpITQmMt3ymhVEBT5EqtT4LvAd0CcDGgIdB8dtB UU4eLU8ecKVOGuW4MxP42ZyY9WbBC3BNtYdoSQXnSSgPJpVBso2bdDIqyzN5hZ2iquE3 /1f2N2eAZq1awMDSyuMvN7KMVSPYaB4uNA1jSqY+3YCRsgc8hnHHBIqKGC/qjTg0S1h6 n+zq1bRXTdiz4tEytwmYGY5dbaL7KNauBVRhK5RA1mtYlWACTCqt09j4xevzUVT1Xyn1 g5R+9b57Es82PYFZD4/MpW5FWn5V4wF1ZkbXqQwlkh+4lz4tdXjWUUqO4Un4OZzHEQAI Wmjg== MIME-Version: 1.0 X-Received: by 10.52.245.42 with SMTP id xl10mr2973376vdc.35.1386183039740; Wed, 04 Dec 2013 10:50:39 -0800 (PST) Received: by 10.52.101.230 with HTTP; Wed, 4 Dec 2013 10:50:39 -0800 (PST) In-Reply-To: References: Date: Wed, 4 Dec 2013 11:50:39 -0700 Message-ID: Subject: Re: Survey: What do you use to interface with Hive? From: Timothy Potter To: user@hive.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org I'm a big user of HCatalog from Pig but wish the HCat code used the RESTful HTTP interface instead of Thrift because the version incompatibilities in Thrift are frankly mind-boggling. We get around them by shading the thrift classes used by HCat Also, have many of scripts that are launched as part of larger workflows from Oozie - nice but again we fight with classpath issues all the time. Oozie at least has some nice classpath isolation between hive and pig actions. Cheers, Tim On Wed, Dec 4, 2013 at 10:31 AM, John Omernik wrote: > This can be an interesting subject, I know orgs that are all over on this > questions. I'd be interested in hearing what you use, how it works for you, > and what you are wishing you had in your interface. > > I'll start: > > We've used a number of things: > - CLI for scheduled jobs. Pros: Solid running, fairly bug free. Cons: not > for analysis of data, clunky in that regard. > > -SQL Squirrel via JDBC: Pros: Supported platform. Some nice analysis > features (keeping old results, sorting of results once obtained, keeping of > old queries Cons: Buggy with Hive, sometimes it just crashes for no reason, > can be frustrating with lots of tabs, hard to extend and add little features > for how you work (from my perspective) > > - Custom web based tools: pros designed around how we interact with our > data. cons: no support, it currently has memory leak issues etc. > > - Apache Hue/Beeswax: Just starting to look into this now. > > I'd be curious on what you are using and challenges/wins you've had. > > Thanks! > > John