hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Pivovarov <>
Subject Re: Function definition in hive
Date Sat, 23 Feb 2013 01:19:55 GMT

Creating Custom UDFs

First, you need to create a new class that extends UDF, with one or more
methods named evaluate.

package com.example.hive.udf;
import org.apache.hadoop.hive.ql.exec.UDF;import;
public final class Lower extends UDF {
  public Text evaluate(final Text s) {
    if (s == null) { return null; }
    return new Text(s.toString().toLowerCase());

(Note that there's already a built-in function for this, it's just an easy

After compiling your code to a jar, you need to add this to the hive
classpath. See the section below on deploying jars.

Once hive is started up with your jars in the classpath, the final step is
to register your function:

create temporary function my_lower as 'com.example.hive.udf.Lower';

Now you can start using it:

hive> select my_lower(title), sum(freq) from titles group by my_lower(title);


Ended Job = job_200906231019_0006
cmo	13.0
vp	7.0

For a more involved example, see this
Deploying jars for User Defined Functions and User Defined SerDes

In order to start using your UDF, you first need to add the code to the

hive> add jar my_jar.jar;
Added my_jar.jar to class path

By default, it will look in the current directory. You can also specify a
full path:

hive> add jar /tmp/my_jar.jar;
Added /tmp/my_jar.jar to class path

Your jar will then be on the classpath for all jobs initiated from that
session. To see which jars have been added to the classpath you can use:

hive> list jars;

On Fri, Feb 22, 2013 at 5:09 PM, Yu PENG <> wrote:

> Hi,
> I am a newbie for Hive. I was assigned a job to do a lot of queries with
> similar structure. I just want to ask if there is a way to define functions
> like other programming languages so that I can call the function with
> different parameters. This will be really helpful. Does anyone know that?
> Thanks,
> Yu Peng

View raw message