Mailing-List: contact pig-commits-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: pig-dev@hadoop.apache.org
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable
From: Apache Wiki <wikidiffs@apache.org>
To: Apache Wiki <wikidiffs@apache.org>
Date: Thu, 25 Feb 2010 19:58:31 -0000
Message-ID: <20100225195831.14998.54753@eos.apache.org>
Subject: 
 =?utf-8?q?=5BPig_Wiki=5D_Update_of_=22Pig070IncompatibleChanges=22_by_Olg?=
 =?utf-8?q?aN?=

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for chang=
e notification.

The "Pig070IncompatibleChanges" page has been changed by OlgaN.
http://wiki.apache.org/pig/Pig070IncompatibleChanges?action=3Ddiff&rev1=3D2=
8&rev2=3D29

--------------------------------------------------

  =

  || Change || Section || Impact || Steps to address || Comments ||
  || Load/Store interface changes || Changes to the Load and Store Function=
s || High || [[LoadStoreMigrationGuide || Load Store Migration Guide]] || ||
- || Data compression becomes load/store function specific || Handling Comp=
ressed Data || Unknow but hopefully low || If compression is needed the und=
erlying Input/Output format would need to support it || ||
+ || Data compression becomes load/store function specific || Handling Comp=
ressed Data || Unknown but hopefully low || If compression is needed the un=
derlying Input/Output format would need to support it || ||
- || Bzip compressed files can no longer have .bz extension || Handling Com=
pressed Data || Low || 1. Rename existing .bz files to .bz2 files. 2. Updat=
e scripts to read/write files with bz2 extension || This change is due to t=
he fact that Text{Input/Output}Format only supports bz2 extension ||
+ || Bzip compressed files in PigStorage format can no longer have .bz exte=
nsion  || Handling Compressed Data || Low || 1. Rename existing .bz files t=
o .bz2 files. 2. Update scripts to read/write files with bz2 extension || T=
his change is due to the fact that Text{Input/Output}Format only supports b=
z2 extension ||
- || Switch to Hadoop's local mode || Local Mode || Low || None || Main cha=
nge is 10-20x performance slowdown. Also, local mode now uses the same UDF =
interfaces to execute UDFs as the MR mode. ||
+ || Switching to Hadoop's local mode || Local Mode || Low || None || Main =
change is 10-20x performance slowdown. Also, local mode now uses the same U=
DF interfaces to execute UDFs as the MR mode. ||
- || Load-Stream or Stream-Store optimizations no longer supported || Strea=
ming || Low to None || None || This feature was never documented so it is u=
nlikely it was ever used ||
+ || Removing support for Load-Stream or Stream-Store optimization || Strea=
ming || Low to None || None || This feature was never documented so it is u=
nlikely it was ever used ||
- || No longer support serialization and decerialization via load/store fun=
ctions || Streaming || Unknown but hopefully low to medium || Implement new=
 Serializer/Deserializer interfaces for non-standard serialization || ||
+ || We no longer support serialization and decerialization via load/store =
functions || Streaming || Unknown but hopefully low to medium || Implement =
new PigToStream and StreamToPig interfaces for non-standard serialization |=
| LoadStoreRedesignProposal ||
- || Removed BinaryStorage builtin || Streaming || Low to None || None || A=
s far as we know, this class was only used internally by streaming ||
+ || Removing BinaryStorage builtin || Streaming || Low to None || None || =
As far as we know, this class was only used internally by streaming ||
- || Split by file feature is removed || Split by File || Low to None || In=
put format of the loader would need to be used || We don't know that this f=
eature was widely/ever used ||
+ || Removing Split by file feature || Split by File || Low to None || Inpu=
t format of the loader would need to support this || We don't know that thi=
s feature was widely/ever used ||
- || Local files no longer accessible from hadoop || Access to Local Files =
from Map-Reduce Mode || low to none || copy the file to the cluster using c=
opyToLocal command || This feature was not documented ||
+ || Local files no longer accessible from cluster || Access to Local Files=
 from Map-Reduce Mode || low to none || copy the file to the cluster using =
copyToLocal command prior to the load || This feature was not documented ||
- || Removing Custom Comparators || Removing Custom Comparators || Low to N=
one || None || This feature has been depricated since Pig 0.5.0 release. We=
 don't have a single known use case ||
+ || Removing Custom Comparators || Removing Custom Comparators || Low to N=
one || None || This feature has been deprecated since Pig 0.5.0 release. We=
 don't have a single known use case ||
  =

  =3D=3D Changes to the Load and Store Functions =3D=3D
 =20