hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <>
Subject [jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job
Date Mon, 11 Jan 2010 06:10:55 GMT


Namit Jain commented on HIVE-964:

Instead of making Driver aware of conditional task - can we change the code structure ?
Pass a context to execute()/initialize() if needed.

The current tasks would ignore the context. But the conditional task would add the resulting
tasks in the queue which will be 
passed in the context.

> handle skewed keys for a join in a separate job
> -----------------------------------------------
>                 Key: HIVE-964
>                 URL:
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: He Yongqiang
>         Attachments: hive-964-2009-12-17.txt, hive-964-2009-12-28-2.patch, hive-964-2009-12-29-4.patch,
> The skewed keys can be written to a temporary table or file, and a followup conditional
task can be used to perform the join on those keys.
> As a first step, JDBM can be used for those keys

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message