hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pete Wyckoff (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4550) Make DynamicSerDe capable of skipping fields that will not be used in the query
Date Thu, 30 Oct 2008 18:20:46 GMT
Make DynamicSerDe capable of skipping fields that will not be used in the query
-------------------------------------------------------------------------------

                 Key: HADOOP-4550
                 URL: https://issues.apache.org/jira/browse/HADOOP-4550
             Project: Hadoop Core
          Issue Type: New Feature
          Components: contrib/hive
            Reporter: Pete Wyckoff


Thrift/DynamicSerDe always deseriualize and convert fields to the correct type for every field
in the record. Many times, only a few of the fields will be used.

e.g., select foo.user from foo where foo.created < 'today'

where foo is something like

struct {
  string user
   i64 created
   string fullname
   string description
    i32 something
    i32 somethingelse
   ...

}

Parsing fullname, description, something and something else is a waste in this case.




-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message