hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-1023) typedbytes: datatypes should be derived from data
Date Thu, 31 Dec 2009 19:03:29 GMT
typedbytes: datatypes should be derived from data
-------------------------------------------------

                 Key: HIVE-1023
                 URL: https://issues.apache.org/jira/browse/HIVE-1023
             Project: Hadoop Hive
          Issue Type: Improvement
          Components: Query Processor
            Reporter: Namit Jain
            Assignee: Namit Jain


FROM (
FROM src
SELECT TRANSFORM(src.key, src.value) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe'
RECORDWRITER 'org.apache.hadoop.hive.contrib.util.typedbytes.TypedBytesRecordWriter'
USING '/bin/cat'
AS (tkey, tvalue) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe'
RECORDREADER 'org.apache.hadoop.hive.contrib.util.typedbytes.TypedBytesRecordReader'
) tmap
INSERT OVERWRITE TABLE dest1 SELECT tkey, tvalue;

The output is interpreted as a string - however, it is assumed that the script is retuning
string data.
It would be useful if the reader and the deserializer can be decoupled.
The record reader (TypedBytesRecordReader) will read the typed data (independent of the output
schema)
and then convert it according to the output schema. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message