datafu-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eyal Allweil (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DATAFU-115) Make TupleFromBag implement Accumulator
Date Thu, 03 Mar 2016 19:35:18 GMT

     [ https://issues.apache.org/jira/browse/DATAFU-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eyal Allweil updated DATAFU-115:
--------------------------------
    Attachment: DATAFU-115.patch

Relatively straightforward patch ... there's one difference from the previous behavior, that
if an exception is thrown, I ignore it and try to continue iterating to the desired index.

I tried uploading it to the review board, see if [this link|https://reviews.apache.org/r/44351/]
works.

> Make TupleFromBag implement Accumulator
> ---------------------------------------
>
>                 Key: DATAFU-115
>                 URL: https://issues.apache.org/jira/browse/DATAFU-115
>             Project: DataFu
>          Issue Type: Improvement
>    Affects Versions: 1.3.0
>            Reporter: Eyal Allweil
>            Priority: Minor
>              Labels: performance
>             Fix For: 1.3.1
>
>         Attachments: DATAFU-115.patch
>
>
> Similar to [DATAFU-114|https://issues.apache.org/jira/browse/DATAFU-114]. 
> TupleFromBag doesn't need to hold the bag in memory, and can iterate through it until
it reaches the desired tuple. By implementing Accumulator, larger bags can be used and with
a smaller memory footprint.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message