pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aniket Mokashi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow
Date Tue, 22 Oct 2013 22:46:43 GMT

    [ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13802378#comment-13802378
] 

Aniket Mokashi commented on PIG-3325:
-------------------------------------

Also, committed to 0.12.

> Adding a tuple to a bag is slow
> -------------------------------
>
>                 Key: PIG-3325
>                 URL: https://issues.apache.org/jira/browse/PIG-3325
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.11, 0.12.0, 0.11.1, 0.11.2
>            Reporter: Mark Wagner
>            Assignee: Dmitriy V. Ryaboy
>            Priority: Critical
>             Fix For: 0.12.1
>
>         Attachments: PIG-3325.2.patch, PIG-3325.3.patch, PIG-3325.4.patch, PIG-3325-benchmark.patch,
PIG-3325.demo.patch, PIG-3325.optimize.1.patch
>
>
> The time it takes to add a tuple to a bag has increased significantly, causing some jobs
to take about 50x longer compared to 0.10.1. I've tracked this down to PIG-2923, which has
made adding a tuple heavier weight (it now includes some memory estimation).



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message