pig-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Pig Wiki] Update of "PigTypesDesign" by AlanGates
Date Wed, 16 Jan 2008 17:02:29 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.

The following page has been changed by AlanGates:
http://wiki.apache.org/pig/PigTypesDesign

------------------------------------------------------------------------------
  semantics specified
  [:PigTypesFunctionalSpec#Argument_Construction_for_Functi:here].
  
+ == Feedback from Design Review Meeting ==
+    * Currently schemas are attached only to tuples.  As part of these changes we should
allow a schema to be attached to a bag.
+    * We need to specify what happens when load encournters a tuple that doesn't match a
user provided schema (For example, user says a = load 'myfile' as (a int, b float, c long),
what happens if load finds a record with 2 fields, with 4?  We should not fail, should give
a warning.  But do we keep the record and try to fit it in (either trimming extra columns
or adding nulls for missing ones) or do we drop the record?
+    * Need to back through the design and make clear what the impact of having nulls in it
is.
+    * Originally we had proposed to make bags take any other type, not just tuples.  Need
to consider the impact of that vs the benefits.
+    * Do we want to change the name of Tuple to Record and Bag to List or RecordSet, for
clarity?
+ 

Mime
View raw message