hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Sichi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1328) make mapred.input.dir.recursive work for select *
Date Thu, 29 Apr 2010 03:40:49 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12862077#action_12862077
] 

John Sichi commented on HIVE-1328:
----------------------------------

Hi Ed,

This is not a new feature--this is an inconsistency in an existing feature when a particular
Hadoop parameter is enabled (it should not matter whether you use select * vs a more complex
select, you should get the same results).

In general, prioritization is driven by a number of factors such as the overall project roadmap,
quality, and the use cases which the developer wants or needs to make work (this one happens
to be important for Facebook, which is why I'm working on it at the moment); if the ones you
mention are high priority for you, please submit patches for them so we can get them resolved.

Regardless of that, thanks for all the bug reports that you have submitted--they're very valuable
in themselves, and we want to get them all fixed too.


> make mapred.input.dir.recursive work for select *
> -------------------------------------------------
>
>                 Key: HIVE-1328
>                 URL: https://issues.apache.org/jira/browse/HIVE-1328
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.6.0
>            Reporter: John Sichi
>            Assignee: John Sichi
>             Fix For: 0.6.0
>
>
> For the script below, we would like the behavior from MAPREDUCE-1501 to apply so that
the select * returns two rows instead of none.
> create table fact_daily(x int)
> partitioned by (ds string);
> create table fact_tz(x int)
> partitioned by (ds string, hr string, gmtoffset string);
> alter table fact_tz 
> add partition (ds='2010-01-03', hr='1', gmtoffset='-8');
> insert overwrite table fact_tz
> partition (ds='2010-01-03', hr='1', gmtoffset='-8')
> select key+11 from src where key=484;
> alter table fact_tz 
> add partition (ds='2010-01-03', hr='2', gmtoffset='-7');
> insert overwrite table fact_tz
> partition (ds='2010-01-03', hr='2', gmtoffset='-7')
> select key+12 from src where key=484;
> alter table fact_daily
> set tblproperties('EXTERNAL'='TRUE');
> alter table fact_daily
> add partition (ds='2010-01-03')
> location '/user/hive/warehouse/fact_tz/ds=2010-01-03';
> set mapred.input.dir.recursive=true;
> select * from fact_daily where ds='2010-01-03';

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message