hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasad Chakka (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-405) Cleanup operator initialization
Date Thu, 16 Jul 2009 06:21:14 GMT

     [ https://issues.apache.org/jira/browse/HIVE-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasad Chakka updated HIVE-405:
-------------------------------

    Attachment: hive-405.6.patch

this refactors operator initialization

1) removes ObjectInspector arg from Operator.process()
2) eliminates one of the 4 operator initialization functions
3) simplified and moved most of MapOperator.initiaizeOp() to a specific function since it
modifies operator graph while initializing it. this move eliminates some of the work arounds
put in initialization code.
4) moved initialization of operators to ExecMapper/ExceReducer.configure() from map() and
reducer().

 

> Cleanup operator initialization
> -------------------------------
>
>                 Key: HIVE-405
>                 URL: https://issues.apache.org/jira/browse/HIVE-405
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.4.0
>            Reporter: Zheng Shao
>            Assignee: Prasad Chakka
>            Priority: Critical
>         Attachments: hive-405.6.patch, hive-405.patch
>
>
> We are always passing the same ObjectInspector, so there is no need to pass it again
and again in forward.
> Also there is a problem that can ONLY be fixed by passing ObjectInspector in init: Outer
Joins - Outer Joins may not be able to get ObjectInspectors for all inputs, as a result, there
is no way to construct an output ObjectInspector based on the inputs. Currently we have hard-coded
code that assumes joins are always outputting Strings, which did break but was hidden by the
old framework (because we do toString() when serializing the output, and toString() is defined
for all Java Classes).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message