pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Coveney (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2855) Provide a method to measure time spent in UDFs
Date Fri, 03 Aug 2012 22:01:02 GMT

    [ https://issues.apache.org/jira/browse/PIG-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13428409#comment-13428409
] 

Jonathan Coveney commented on PIG-2855:
---------------------------------------

Love the idea.

One potential issue... with POUser func, it looks like your counter group is FuncSpec#toString,
which means multiple invocations of the same UDF in different parts of the code will go to
the same counter.
                
> Provide a method to measure time spent in UDFs
> ----------------------------------------------
>
>                 Key: PIG-2855
>                 URL: https://issues.apache.org/jira/browse/PIG-2855
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Dmitriy V. Ryaboy
>         Attachments: PIG-2855.2.patch, PIG-2855.patch
>
>
> When debugging slow jobs, it is often useful to know whether time is being spent in UDFs,
and in which UDFs. This is easy to measure from within the framework, we should let users
optionally track these metrics.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message