hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "hc busy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1016) Reading in map data seems broken
Date Fri, 16 Oct 2009 18:10:31 GMT

    [ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766634#action_12766634
] 

hc busy commented on PIG-1016:
------------------------------

Thanks to everyone who is reviewing this ticket. I really appreciate it!

This feature is important because the data I have is slightly hierarchical (maps(string#map(:))
Some times I need to sort by values corresponding to one key in the map, while other times
I need to merge on a value corresponding to a different key of the map.

Aside from the unit tests running, I also performed some join tests from this parser. The
results are all fine except for the skew join, which produced twice as many rows as was right...
has anybody else encountered this problem? Or is it only a result of taking values from a
map?


thanks!

> Reading in map data seems broken
> --------------------------------
>
>                 Key: PIG-1016
>                 URL: https://issues.apache.org/jira/browse/PIG-1016
>             Project: Pig
>          Issue Type: Improvement
>          Components: data
>    Affects Versions: 0.4.0
>            Reporter: hc busy
>         Attachments: PIG-1016.patch
>
>
> Hi, I'm trying to load a map that has a tuple for value. The read fails in 0.4.0 because
of a misconfiguration in the parser. Where as in almost all documentation it is stated that
value of the map can be any time.
> I've attached a patch that allows us to read in complex objects as value as documented.
I've done simple verification of loading in maps with tuple/map values and writing them back
out using LOAD and STORE. All seems to work fine.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message