hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <>
Subject [jira] Commented: (HIVE-1349) Do not pull counters of non initialized jobs
Date Tue, 18 May 2010 22:08:44 GMT


Ning Zhang commented on HIVE-1349:

Can you add the new hive parameter to conf/hive-default.xml as well? Other than that it looks

> Do not pull counters of non initialized jobs
> --------------------------------------------
>                 Key: HIVE-1349
>                 URL:
>             Project: Hadoop Hive
>          Issue Type: Improvement
>            Reporter: Dmytro Molkov
>         Attachments: HIVE-1349.patch
> Right now hive client puts a lot of pressure on the jobtracker by pulling the counters
of the job that has just been submitted and is in the process of initializing tasks.
> While the job initialized tasks and reads the splits file it is holding the JobInProgress
lock. The getCounters method acquires a JobTracker lock and waits for the JobInProgress lock.
Since the read of the file can  take a couple (a couple of tens of seconds) the job tracker
is effectively blocked for that period of time.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message