datafu-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eyal Allweil (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DATAFU-115) Make TupleFromBag implement Accumulator
Date Sun, 27 Mar 2016 17:44:25 GMT

    [ https://issues.apache.org/jira/browse/DATAFU-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213559#comment-15213559
] 

Eyal Allweil commented on DATAFU-115:
-------------------------------------

I'm not sure why, but I can't see this patch in the master branch. I can see https://issues.apache.org/jira/browse/DATAFU-114
- [FirstTupleFromBag|https://github.com/apache/incubator-datafu/blob/master/datafu-pig/src/main/java/datafu/pig/bags/FirstTupleFromBag.java]
appears changed - but [TupleFromBag|https://github.com/apache/incubator-datafu/blob/master/datafu-pig/src/main/java/datafu/pig/bags/TupleFromBag.java]
looks like it hasn't been changed since August. Does the public GitHub represent the repository
accurately?

> Make TupleFromBag implement Accumulator
> ---------------------------------------
>
>                 Key: DATAFU-115
>                 URL: https://issues.apache.org/jira/browse/DATAFU-115
>             Project: DataFu
>          Issue Type: Improvement
>    Affects Versions: 1.3.0
>            Reporter: Eyal Allweil
>            Assignee: Eyal Allweil
>            Priority: Minor
>              Labels: performance
>             Fix For: 1.3.1
>
>         Attachments: DATAFU-115.patch
>
>
> Similar to [DATAFU-114|https://issues.apache.org/jira/browse/DATAFU-114]. 
> TupleFromBag doesn't need to hold the bag in memory, and can iterate through it until
it reaches the desired tuple. By implementing Accumulator, larger bags can be used and with
a smaller memory footprint.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message