Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of metaruslan@gmail.com designates
 209.85.215.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAN7ydrOi6Hu-dwgfY+XQcYk8SmweZPmEOE_yu7cvyAfCwaKZYg@mail.gmail.com>
References: 
 <CACBYqwTPKKyKzEA7Lp8wPPgSHp=2ZOoajBDTXKOZRfbhZs_cnQ@mail.gmail.com>
	<CAN7ydrPeT6Vmv+e0RnV6zVtVjqrbffajdQRhffqqsJE1gAKtGA@mail.gmail.com>
	<CAH8dpCZcjkdk0J2oNS=yUexB_Egt4-GWeVJdfwN-zx2sUsjCkA@mail.gmail.com>
	<CAN7ydrOi6Hu-dwgfY+XQcYk8SmweZPmEOE_yu7cvyAfCwaKZYg@mail.gmail.com>
Date: Fri, 15 Jun 2012 21:28:13 +0400
Message-ID: 
 <CACBYqwR=AitXT6g7xD_Zc86n+tZN8PFz2fkMokzyzASRcLMFQA@mail.gmail.com>
Subject: Re: Quering RDBMS table in a Hive query
From: Ruslan Al-Fakikh <metaruslan@gmail.com>
To: user@hive.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Thanks Jan

On Fri, Jun 15, 2012 at 4:35 PM, Jan Dolin=E1r <dolik.rce@gmail.com> wrote:
> On 6/15/12, Ruslan Al-Fakikh <ruslan.al-fakikh@jalent.ru> wrote:
>> I didn't know InputFormat and LineReader could help, though I didn't
>> look at them closely. I was thinking about implementing a
>> Table-Generating Function (UDTF) if there is no an already implemented
>> solution.
>
> Both is possible, InputFormat and/or UD(T)F. It all depends on what
> you need. I actually use both - in Input format I load lists of
> allowed values to check the data and in UDF I query some other
> database for values necessary only in some queries. Generally, I'd use
> =A0InputFormat for situations where all jobs over given table would
> require the additional data from RDBMS. Oppositely, in situations
> where only few jobs out of many requires the RDBMS connection, I would
> use UDF.
>
> I think that the difference in performance between the two is rather
> small, if any. Also UDF is easier to write, so it might be the "weapon
> of choice", at least if you don't already use custom InputFormat.
>
> Jan