hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Thusoo (JIRA)" <>
Subject [jira] Commented: (HIVE-1131) Add column lineage information to the pre execution hooks
Date Thu, 25 Mar 2010 09:01:28 GMT


Ashish Thusoo commented on HIVE-1131:

Comment 3 from Raghu and comment S2-S4 from Zheng are not yet incorporated.

The new patch overhauls things a bit to support Partition level lineage and does this in a
post execute hook. It gets rid of the visits and the iterator classes. Will fix the other
comments in the patch with the test cases.

> Add column lineage information to the pre execution hooks
> ---------------------------------------------------------
>                 Key: HIVE-1131
>                 URL:
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Ashish Thusoo
>            Assignee: Ashish Thusoo
>         Attachments: HIVE-1131.patch, HIVE-1131_2.patch
> We need a mechanism to pass the lineage information of the various columns of a table
to a pre execution hook so that applications can use that for:
> - auditing
> - dependency checking
> and many other applications.
> The proposal is to expose this through a bunch of classes to the pre execution hook interface
to the clients and put in the necessary transformation logic in the optimizer to generate
this information.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message