hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siying Dong (JIRA)" <>
Subject [jira] Created: (HIVE-1249) MapJoin to Check Number of Files to Match Metadata
Date Tue, 16 Mar 2010 22:16:27 GMT
MapJoin to Check Number of Files to Match Metadata

                 Key: HIVE-1249
             Project: Hadoop Hive
          Issue Type: Improvement
          Components: Query Processor
            Reporter: Siying Dong
            Assignee: Namit Jain
            Priority: Minor

Sorted Map Join only can execute when two tables' bucket numbers are the same.
Currently, the checking is done by looking at metadata of the table. However, for some reason,
the real physical storage is not guaranteed to follow what the metadata indicates. In that
case, Sorted Map Join might fail to identify it and deliver wrong results. An extra check
when storage scan is necessary to deal with the scenario.

This issue may also apply to normal map join.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message