pig-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Pig Wiki] Update of "Pig070IncompatibleChanges" by OlgaN
Date Thu, 25 Feb 2010 19:58:31 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.

The "Pig070IncompatibleChanges" page has been changed by OlgaN.
http://wiki.apache.org/pig/Pig070IncompatibleChanges?action=diff&rev1=28&rev2=29

--------------------------------------------------

  
  || Change || Section || Impact || Steps to address || Comments ||
  || Load/Store interface changes || Changes to the Load and Store Functions || High || [[LoadStoreMigrationGuide
|| Load Store Migration Guide]] || ||
- || Data compression becomes load/store function specific || Handling Compressed Data ||
Unknow but hopefully low || If compression is needed the underlying Input/Output format would
need to support it || ||
+ || Data compression becomes load/store function specific || Handling Compressed Data ||
Unknown but hopefully low || If compression is needed the underlying Input/Output format would
need to support it || ||
- || Bzip compressed files can no longer have .bz extension || Handling Compressed Data ||
Low || 1. Rename existing .bz files to .bz2 files. 2. Update scripts to read/write files with
bz2 extension || This change is due to the fact that Text{Input/Output}Format only supports
bz2 extension ||
+ || Bzip compressed files in PigStorage format can no longer have .bz extension  || Handling
Compressed Data || Low || 1. Rename existing .bz files to .bz2 files. 2. Update scripts to
read/write files with bz2 extension || This change is due to the fact that Text{Input/Output}Format
only supports bz2 extension ||
- || Switch to Hadoop's local mode || Local Mode || Low || None || Main change is 10-20x performance
slowdown. Also, local mode now uses the same UDF interfaces to execute UDFs as the MR mode.
||
+ || Switching to Hadoop's local mode || Local Mode || Low || None || Main change is 10-20x
performance slowdown. Also, local mode now uses the same UDF interfaces to execute UDFs as
the MR mode. ||
- || Load-Stream or Stream-Store optimizations no longer supported || Streaming || Low to
None || None || This feature was never documented so it is unlikely it was ever used ||
+ || Removing support for Load-Stream or Stream-Store optimization || Streaming || Low to
None || None || This feature was never documented so it is unlikely it was ever used ||
- || No longer support serialization and decerialization via load/store functions || Streaming
|| Unknown but hopefully low to medium || Implement new Serializer/Deserializer interfaces
for non-standard serialization || ||
+ || We no longer support serialization and decerialization via load/store functions || Streaming
|| Unknown but hopefully low to medium || Implement new PigToStream and StreamToPig interfaces
for non-standard serialization || LoadStoreRedesignProposal ||
- || Removed BinaryStorage builtin || Streaming || Low to None || None || As far as we know,
this class was only used internally by streaming ||
+ || Removing BinaryStorage builtin || Streaming || Low to None || None || As far as we know,
this class was only used internally by streaming ||
- || Split by file feature is removed || Split by File || Low to None || Input format of the
loader would need to be used || We don't know that this feature was widely/ever used ||
+ || Removing Split by file feature || Split by File || Low to None || Input format of the
loader would need to support this || We don't know that this feature was widely/ever used
||
- || Local files no longer accessible from hadoop || Access to Local Files from Map-Reduce
Mode || low to none || copy the file to the cluster using copyToLocal command || This feature
was not documented ||
+ || Local files no longer accessible from cluster || Access to Local Files from Map-Reduce
Mode || low to none || copy the file to the cluster using copyToLocal command prior to the
load || This feature was not documented ||
- || Removing Custom Comparators || Removing Custom Comparators || Low to None || None ||
This feature has been depricated since Pig 0.5.0 release. We don't have a single known use
case ||
+ || Removing Custom Comparators || Removing Custom Comparators || Low to None || None ||
This feature has been deprecated since Pig 0.5.0 release. We don't have a single known use
case ||
  
  == Changes to the Load and Store Functions ==
  

Mime
View raw message