pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-12) Please add timestamps to pig map/reduce progress messages
Date Fri, 02 Nov 2007 02:51:50 GMT
Please add timestamps to pig map/reduce progress messages

                 Key: PIG-12
                 URL: https://issues.apache.org/jira/browse/PIG-12
             Project: Pig
          Issue Type: Improvement
            Reporter: Olga Natkovich
            Priority: Minor

>From one of the users: 
I'm spending a lot of time trying to optimize my pig queries for short
run-times.  This process would be much easier if, in the progress output
from pig (currently on stdout, but hopefully soon moving to  
stderr?!), the
initiation and completion of each map/reduce job could be  
timestamped.  Pig
already spits out messages of the form "----- MapReduce Job -----",  
...", "Combine: ...", etc; could you just add a "Timestamp: ..."
field as well?	Or ideally, both "Starting timestamp: ..." and	
timestamp ...".

Additional comments from another user:

I'm adding my vote for this as well.

I'd like to know timestamp and "running time" in seconds or D;H:M:S:

Thu Oct 25 10:06:01 GMT 2007 (0:00:12:56): 56% done

Starting and stopping timestamps in the log would also be valuable.

Unforutately, there's no "workaround" such as putting a date command before and after the
pig command in logging --
queuing times can be seconds to hours and completely mess up any notion of job execution time.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message