hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Molkov (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-1349) Do not pull counters of non initialized jobs
Date Tue, 18 May 2010 18:41:51 GMT
Do not pull counters of non initialized jobs

                 Key: HIVE-1349
                 URL: https://issues.apache.org/jira/browse/HIVE-1349
             Project: Hadoop Hive
          Issue Type: Improvement
            Reporter: Dmytro Molkov

Right now hive client puts a lot of pressure on the jobtracker by pulling the counters of
the job that has just been submitted and is in the process of initializing tasks.
While the job initialized tasks and reads the splits file it is holding the JobInProgress
lock. The getCounters method acquires a JobTracker lock and waits for the JobInProgress lock.
Since the read of the file can  take a couple (a couple of tens of seconds) the job tracker
is effectively blocked for that period of time.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message