hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-2324) Enhancing local mode execution with non-HDFS related queries
Date Fri, 29 Jul 2011 18:04:11 GMT

     [ https://issues.apache.org/jira/browse/HIVE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ning Zhang updated HIVE-2324:
-----------------------------

    Description: 
Local mode execution are decided based on the input size. There are queries that do not involve
data resides in HDFS at all. We should enhance local mode execution with these types of queries:

1) metadata only queries (HIVE-178, HIVE-1003). eg.,
{code}
  SELECT max(ds) From T WHERE ts = 'some_partition';  -- both ds and ts are partition columns
{code}

2) DUAL table (HIVE-1558):
{code}
  SELECT MYUDF('constant1', 'constant2') FROM DUAL;
  SELECT MYUDAF(...) FROM ( SELECT 'const1' col1, 'const2' col2 FROM DUAL ) A GROUP BY col1;
{code}


  was:
Local mode execution are decided based on the input size. There are queries that do not involve
data resides in HDFS at all. We should enhance local mode execution with these types of queries:

1) metadata only queries. eg.,
{code}
  SELECT max(ds) From T WHERE ts = 'some_partition';  -- both ds and ts are partition columns
{code}

2) DUAL table (HIVE-1558):
{code}
  SELECT MYUDF('constant1', 'constant2') FROM DUAL;
  SELECT MYUDAF(...) FROM ( SELECT 'const1' col1, 'const2' col2 FROM DUAL ) A GROUP BY col1;
{code}



> Enhancing local mode execution with non-HDFS related queries 
> -------------------------------------------------------------
>
>                 Key: HIVE-2324
>                 URL: https://issues.apache.org/jira/browse/HIVE-2324
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Ning Zhang
>
> Local mode execution are decided based on the input size. There are queries that do not
involve data resides in HDFS at all. We should enhance local mode execution with these types
of queries:
> 1) metadata only queries (HIVE-178, HIVE-1003). eg.,
> {code}
>   SELECT max(ds) From T WHERE ts = 'some_partition';  -- both ds and ts are partition
columns
> {code}
> 2) DUAL table (HIVE-1558):
> {code}
>   SELECT MYUDF('constant1', 'constant2') FROM DUAL;
>   SELECT MYUDAF(...) FROM ( SELECT 'const1' col1, 'const2' col2 FROM DUAL ) A GROUP BY
col1;
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message