Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A24A910380 for ; Tue, 13 Aug 2013 16:14:27 +0000 (UTC) Received: (qmail 64137 invoked by uid 500); 13 Aug 2013 16:14:26 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 63530 invoked by uid 500); 13 Aug 2013 16:14:25 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 63521 invoked by uid 99); 13 Aug 2013 16:14:25 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Aug 2013 16:14:25 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jonathan.bender@gmail.com designates 209.85.219.50 as permitted sender) Received: from [209.85.219.50] (HELO mail-oa0-f50.google.com) (209.85.219.50) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Aug 2013 16:14:18 +0000 Received: by mail-oa0-f50.google.com with SMTP id i4so11535268oah.23 for ; Tue, 13 Aug 2013 09:13:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=R1J4mc6Nq5t7npjbGK/Lr/IeTjIjRV98gor6DgP1E0M=; b=bRU/Aqh+fiABoFXPsi1d88p8rEGGFj40RfoM6Zlx9uI1UpXrWsoHJlB1puB3Tp3rHn SLqZEaLrYSQLjbmSYhIKEW5NOxbuWthrTAvTt7BG7cONLAUwIqECOMXdH38Q4O7K0r/m qdcrWXO0VKXF5JfGZt+l80FYCdbNVs9F4ikPcYzKELbWVTFSJ4Dp/JKESGuq3+X0zt+o ig618z7LplfyPSB1Z9A1K8hMGvydEHRjyh2vfft1Gr95gNS4b8N9uuDO5FF41h/beGx1 aJsh3qNym6QuO16tnQ5s4IexTs3VQ1NjjYygd5T949p1gOuYB7PNB4jLT7O57Ji5YUDL bjNA== X-Received: by 10.182.72.234 with SMTP id g10mr1748133obv.60.1376410437478; Tue, 13 Aug 2013 09:13:57 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.154.197 with HTTP; Tue, 13 Aug 2013 09:13:37 -0700 (PDT) From: Jon Bender Date: Tue, 13 Aug 2013 09:13:37 -0700 Message-ID: Subject: Passing mapreduce configuration parameters to hive udf To: user@hive.apache.org Content-Type: multipart/alternative; boundary=001a11c2e06430ee1504e3d6873e X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2e06430ee1504e3d6873e Content-Type: text/plain; charset=ISO-8859-1 Hi there, I'm trying to pass some external properties to a UDF. In the MapReduce world I'm used to extending Configured in my classes, but in my UDF class when initializing a new Configuration object or HiveConf object it doesn't inherit any of those properties. I see it in the Job Configuration XML when the job runs but my UDF can't pick it up when it creates a new instance. Are there any other suggested ways of doing this? I could probably just add some conf file to distributed cache and load the properties on UDF initialization, but I figured I could get at the configuration through other means. Thanks in advance, Jon --001a11c2e06430ee1504e3d6873e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi there,

I'm trying to pass some e= xternal properties to a UDF. =A0In the MapReduce world I'm used to exte= nding Configured in my classes, but in my UDF class when initializing a new= Configuration object or HiveConf object it doesn't inherit any of thos= e properties. =A0I see it in the Job Configuration XML when the job runs bu= t my UDF can't pick it up when it creates a new instance.

Are there any other suggested ways of doing this? =A0I = could probably just add some conf file to distributed cache and load the pr= operties on UDF initialization, but I figured I could get at the configurat= ion through other means.

Thanks in advance,
Jon
--001a11c2e06430ee1504e3d6873e--