hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Capriolo (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-617) Script to start classes with hadoop and hive environment
Date Thu, 30 Jul 2009 20:18:14 GMT

    [ https://issues.apache.org/jira/browse/HIVE-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12737261#action_12737261

Edward Capriolo commented on HIVE-617:

I follow what you are saying. 

We may not need to add a helper class for the user.  The user that would be using this is
likely advanced and should/would use the OptionsProcessor and SessionState as they see fit.

A reason I could see for creating HiveShell is we would like to retrofit all the current tools
cli, lineage, hwi to fit into some interface ensure that the SessionState, hive history, and
etc is started up properly.

My use case is to be able to launch a class that can start a map/reduce program with the hadoop
API and then execute a query with the hive API.  I am using GregorianCalendar and date processing
to figure out what files/partition to operate on, building hive strings and executing them
directly with the QueryProcessor. 

It seems some people are using a combination of bash|perl|python and hive -e|-f. Other then
my reliance on cron to start off these jobs, I am 100% pure Java. 

This tiny shell script is my entry point. For me, it does not need more sophistication but
I could be missing something. 

> Script to start classes with hadoop and hive environment
> --------------------------------------------------------
>                 Key: HIVE-617
>                 URL: https://issues.apache.org/jira/browse/HIVE-617
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Clients
>            Reporter: Edward Capriolo
>            Assignee: Edward Capriolo
>            Priority: Minor
>         Attachments: hive-617.2.patch, hive-617.3.diff, hive-617.patch, TestHive.java
> At times it may be required to write a process that uses both the Hadoop and Hive environment
and API. For example, someone may write an application that uses the HIVE api directly. This
patch will add a more generic --jar extension that can start any class with the proper environment.
> RUNJAR=/opt/hive/lib/hive_hwi.jar RUNCLASS=test.TestHive hive --service jar

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message