hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-10) reduce encoding of intermediate results
Date Fri, 02 Nov 2007 02:41:50 GMT
reduce encoding of intermediate results
---------------------------------------

                 Key: PIG-10
                 URL: https://issues.apache.org/jira/browse/PIG-10
             Project: Pig
          Issue Type: Improvement
          Components: impl
            Reporter: Olga Natkovich


Currently, in intermediate results, the data is written with a marker for every column in
every row.  For instance if
we are writing a row that has a schema of bag, atom, we'll write:

BAGMARKER BAGDATA ATOMMARKER ATOMDATA


There's no reason to write the markers for every row.  Is should be sufficient to write it
once at the beginning of the
file and then remember it for subsequent rows.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message