hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Hanson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4961) Create bridge for custom UDFs to operate in vectorized mode
Date Mon, 16 Sep 2013 23:50:52 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768969#comment-13768969
] 

Eric Hanson commented on HIVE-4961:
-----------------------------------

I ran the failing tests on my machine on a clean version of the vectorization branch without
my patch. These tests failed:

org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_plan_json
org.apache.hadoop.hive.ql.io.orc.TestFileDump.testDictionaryThreshold
org.apache.hadoop.hive.ql.io.orc.TestFileDump.testDump

These tests would not run in a way that produced output in ant testreport, and my changes
should not affect them.

org.apache.hcatalog.listener.TestNotificationListener.testAMQListener
org.apache.hive.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTable
org.apache.hive.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask
org.apache.hive.hcatalog.pig.TestHCatStorer.testPartColsInData
org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreInPartiitonedTbl
org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreMultiTables
org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreWithNoSchema

                
> Create bridge for custom UDFs to operate in vectorized mode
> -----------------------------------------------------------
>
>                 Key: HIVE-4961
>                 URL: https://issues.apache.org/jira/browse/HIVE-4961
>             Project: Hive
>          Issue Type: Sub-task
>    Affects Versions: vectorization-branch
>            Reporter: Eric Hanson
>            Assignee: Eric Hanson
>             Fix For: vectorization-branch
>
>         Attachments: HIVE-4961.1-vectorization.patch, HIVE-4961.2-vectorization.patch,
HIVE-4961.3-vectorization.patch, vectorUDF.4.patch, vectorUDF.5.patch, vectorUDF.8.patch,
vectorUDF.9.patch
>
>
> Suppose you have a custom UDF myUDF() that you've created to extend hive. The goal of
this JIRA is to create a facility where if you run a query that uses myUDF() in an expression,
the query will run in vectorized mode.
> This would be a general-purpose bridge for custom UDFs that users add to Hive. It would
work with existing UDFs.
> I'm considering a separate JIRA for a new kind of custom UDF implementation that is vectorized
from the beginning, to optimize performance. That is not covered by this JIRA.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message