pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy V. Ryaboy (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2359) Support more efficient Tuples when schemas are known
Date Tue, 17 Jan 2012 01:41:38 GMT

     [ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Dmitriy V. Ryaboy updated PIG-2359:

       Resolution: Fixed
    Fix Version/s: 0.11
     Release Note: 
newTupleForSchema(Schema s) and newTupleForSchema(byte... types) methods are introduced to
TupleFactory, allowing Pig to choose optimized Tuple implementations for specific schemas,
when those are available.

Two optimized implementations are introduced:
- single-value Tuples (tuples which only hold a single int, double, String, etc
- primitive-value Tuples (tuples which only hold values that can be represented by a fixed-width
datatype in Java: int, long, double, boolean, float).

Using such tuples can result in significant memory utilization improvements.
           Status: Resolved  (was: Patch Available)

Committed to trunk.
> Support more efficient Tuples when schemas are known
> ----------------------------------------------------
>                 Key: PIG-2359
>                 URL: https://issues.apache.org/jira/browse/PIG-2359
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Dmitriy V. Ryaboy
>             Fix For: 0.11
>         Attachments: PIG-2359.1.patch, PIG-2359.2.patch, PIG-2359.3.patch, PIG-2359.4.patch
> Pig Tuples have significant overhead due to the fact that all the fields are Objects.
> When a Tuple only contains primitive fields (ints, longs, etc), it's possible to avoid
this overhead, which would result in significant memory savings.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message