hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ladda, Anand" <lan...@microstrategy.com>
Subject RE: Hive Meta Information
Date Tue, 03 Apr 2012 13:19:33 GMT
Thanks Thiruvel and Ed. Might be a dump question but how exactly do I get to to audit Hive
metastore audit logs. I looked through the JIRA but there isn't a mention of the same. Also
is there some variable/parameter I need to set/enable for the audit logging to be turned on

-----Original Message-----
From: Thiruvel Thirumoolan [mailto:thiruvel@yahoo-inc.com] 
Sent: Monday, April 02, 2012 5:47 AM
To: user@hive.apache.org
Subject: Re: Hive Meta Information

> 1.       recent users of table,
> 2.       top users of table,

Hive metastore has audit support (HIVE-1948). While what Edward suggests will be accurate,
audit log might give you a superset of that, it will also include "desc table" requests.

Thiruvel



On 3/31/12 8:39 PM, "Edward Capriolo" <edlinuxguru@gmail.com> wrote:

>hive does not capture this information.
>
>I have a tool on github that connects to the JobTracker and pulls stat 
>information.
>
>https://github.com/edwardcapriolo/hadoop_cluster_profiler
>
>It would be pretty easy to add code to record some of information you 
>are looking for.
>
>Hive is close to #4 with a statistics DB used for indexing/query planning.
>
>Edward
>
>On Sat, Mar 31, 2012 at 2:50 AM, Nitin Pawar <nitinpawar432@gmail.com>
>wrote:
>> Anand,
>>
>> I doubt this information is readily available in hive as this is not 
>>meta  information rather access information.
>>
>> For number of records in a table you can just run a query like select
>> count(1) from table;
>>
>>
>> For the access details on table data, you will need to process hadoop 
>>logs  and based on that you can figure out who accessed the data and 
>>how
>>
>> Thanks,
>> Nitin
>>
>> On Sat, Mar 31, 2012 at 3:36 AM, Ladda, Anand 
>> <lanand@microstrategy.com>
>> wrote:
>>>
>>> How do I get the following meta information about a table
>>>
>>> 1.       recent users of table,
>>>
>>> 2.       top users of table,
>>>
>>> 3.       recent queries/jobs/reports,
>>>
>>> 4.       number of rows in a table
>>>
>>>
>>>
>>> I donĀ¹t see anything either in DESCRIBE FORMATTED or SHOW TABLE 
>>>EXTENDED  LIKE commands.
>>>
>>> Thanks
>>>
>>> Anand
>>
>>
>>
>>
>> --
>> Nitin Pawar
>>


Mime
View raw message