pig-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Pig Wiki] Update of "Pig070IncompatibleChanges" by OlgaN
Date Wed, 24 Feb 2010 00:20:08 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.

The "Pig070IncompatibleChanges" page has been changed by OlgaN.
http://wiki.apache.org/pig/Pig070IncompatibleChanges?action=diff&rev1=21&rev2=22

--------------------------------------------------

  
  With Pig 0.7.0 the read/write functionality is taking over by Hadoop's Input/OutputFormat
and how compression is handled or whether it is handled at all depends on the Input/OutputFormat
used by the loader/store function.
  
- The main input format that supports compression is TextInputFormat. It supports bzip files
with .bz2 extension and gzip files with .gz extension. '''Note that it does not support .bz
files'''. PigStorage is the only loader that comes with Pig that is derived from TextInputFormat
which means it will be able to handle .bz2 and .gz files. Other laders such as BinStorage
will no longer support compression.
+ The main input format that supports compression is TextInputFormat. It supports bzip files
with .bz2 extension and gzip files with .gz extension. '''Note that it does not support .bz
files'''. PigStorage is the only loader that comes with Pig that is derived from TextInputFormat
which means it will be able to handle .bz2 and .gz files. Other loaders such as BinStorage
will no longer support compression.
  
  On the store side, TextOutputFormat also supports compression but the store function needs
do to additional work to enable it. Again, PigStorage will support compressions while other
functions will not.
  

Mime
View raw message