hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Arthur Ciccolo (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-698) Simple join fails on records not loaded with schema
Date Tue, 10 Mar 2009 01:22:51 GMT

     [ https://issues.apache.org/jira/browse/PIG-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Peter Arthur Ciccolo updated PIG-698:
-------------------------------------

    Description: 
Joins can fail with an out-of-bounds access to fields that are not referenced in the script
when records without schema (including all variable-length records) are involved.
Example by Ben Reed:
i1:
1       c       D       E
1       a       B

i2:
0
0       Q
1       x       z
1       a       b       c


i1 = load 'i1';                                                                          
                                                                                         
   
i2 = load 'i2';                                                                          
                                                                                         
   
j = join i1 by $0, i2 by $0;                                                             
                                                                                         
   
dump j

  was:
Joins can fail with an out-of-bounds access to fields that are not referenced in the script
when variable-length
records are involved.
Example by Ben Reed:
i1:
1       c       D       E
1       a       B

i2:
0
0       Q
1       x       z
1       a       b       c


i1 = load 'i1';                                                                          
                                                                                         
   
i2 = load 'i2';                                                                          
                                                                                         
   
j = join i1 by $0, i2 by $0;                                                             
                                                                                         
   
dump j

        Summary: Simple join fails on records not loaded with schema  (was: Simple join fails
on variable-length records)

> Simple join fails on records not loaded with schema
> ---------------------------------------------------
>
>                 Key: PIG-698
>                 URL: https://issues.apache.org/jira/browse/PIG-698
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>         Environment: Yahoo! clusters.
>            Reporter: Peter Arthur Ciccolo
>
> Joins can fail with an out-of-bounds access to fields that are not referenced in the
script when records without schema (including all variable-length records) are involved.
> Example by Ben Reed:
> i1:
> 1       c       D       E
> 1       a       B
> i2:
> 0
> 0       Q
> 1       x       z
> 1       a       b       c
> i1 = load 'i1';                                                                     
                                                                                         
        
> i2 = load 'i2';                                                                     
                                                                                         
        
> j = join i1 by $0, i2 by $0;                                                        
                                                                                         
        
> dump j

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message