pig-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Pig Wiki] Update of "PigExecutionModel" by UtkarshSrivastava
Date Tue, 22 Jan 2008 07:19:19 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.

The following page has been changed by UtkarshSrivastava:
http://wiki.apache.org/pig/PigExecutionModel

------------------------------------------------------------------------------
  === Proposal ===
  
   1. Single-threaded execution.
-  1. No API changes to UDFs in the short term. In the long term, we might introduce an aggregation
function API that is push-based along the lines of the [http://www.postgresql.org/docs/8.2/static/sql-createaggregate.html
Postgres user-defined aggregation function API.
+  1. No API changes to UDFs in the short term. In the long term, we might introduce an aggregation
function API that is push-based along the lines of the [http://www.postgresql.org/docs/8.2/static/sql-createaggregate.html
Postgres user-defined aggregation function API].
-  1. Make the model entirely *push-based*. Reasons:
+  1. Make the model entirely '''push-based'''. Reasons:
      1. Accomodates multiple outputs more naturally.
      1. Accomodates possible future change of having special aggregate function API to iterate
over data only once.
      1. Functions can still pull data; we will push an entire iterator to them, instead of
pushing tuple by tuple.

Mime
View raw message