hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-348) Provide type information to custom mappers and reducers.
Date Tue, 21 Jul 2009 21:23:14 GMT

    [ https://issues.apache.org/jira/browse/HIVE-348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12733835#action_12733835

Zheng Shao commented on HIVE-348:

I think we should pass type information in the environment variable.

> Provide type information to custom mappers and reducers.
> --------------------------------------------------------
>                 Key: HIVE-348
>                 URL: https://issues.apache.org/jira/browse/HIVE-348
>             Project: Hadoop Hive
>          Issue Type: Improvement
>            Reporter: Venky Iyer
> Either by setting an environment variable with the schema, or (ideally), configurably
passing JSON data to custom mappers/reducers. This would be more data to pump into the pipe
on each mapper/reducer, but it would be generated on the mapper/reducer, and it may mean much
less processing for the custom script (using a fast json library compared to casting each
column that needs casting based on the schema). 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message