hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <els...@apache.org>
Subject Re: [DISCUSS] FileSystem Quotas in HBase
Date Fri, 28 Oct 2016 16:26:17 GMT
Sure thing, Ted.


Let me open an umbrella issue for now. I can break up the work later.


Ted Yu wrote:
> Josh:
> Can you put the doc in google doc so that people can comment on it ?
> Is there a JIRA opened for this work ?
> Please open one if there is none.
> Thanks
> On Fri, Oct 28, 2016 at 9:00 AM, Josh Elser<elserj@apache.org>  wrote:
>> Hi folks,
>> I'd like to propose the introduction of FileSystem quotas to HBase.
>> Here's a design doc[1] available which (hopefully) covers all of the
>> salient points of what I think an initial version of such a feature would
>> include.
>> tl;dr We can define quotas on tables and namespaces. Region size is
>> computed by RegionServers and sent to the Master. The Master inspects the
>> sizes of Regions, rolling up to table and namespace sizes. Defined quotas
>> in the quota table are evaluated given the computed sizes, and, for those
>> tables/namespaces violating the quota, RegionServers are informed to take
>> some action to limit any further filesystem growth by that table/namespace.
>> I'd encourage you to give the document a read -- I tried to cover as much
>> as I could without getting unnecessarily bogged down in implementation
>> details.
>> Feedback is, of course, welcomed. I'd like to start sketching out a
>> breakdown of the work (all writing and no programming makes Josh a sad
>> boy). I'm happy to field any/all questions. Thanks in advance.
>> - Josh
>> [1] http://home.apache.org/~elserj/hbase/FileSystemQuotasforApac
>> heHBase.pdf

View raw message