hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alex Baranau <alex.barano...@gmail.com>
Subject Re: Schema Updates: what do you do today?
Date Tue, 10 Apr 2012 03:23:29 GMT
I think I saw one effort of creating a nice tool for doing that long time
ago... Aha, here it is: https://github.com/larsgeorge/hbase-schema-manager.
Might be outdated.. Lars?

As for us, we do changes really rarely (usually have one table with one
columnfamily in it), so one-off shell scripts work well.

Alex Baranau
------
Sematext :: http://blog.sematext.com/ :: Solr - Lucene - Hadoop - HBase

On Mon, Apr 9, 2012 at 3:39 PM, Ian Varley <ivarley@salesforce.com> wrote:

> Thanks, Andy. Yeah, a tool that compares a schema definition with a
> running cluster, and gives you a way to apply changes (without offlining,
> where possible), would be pretty sweet.
>
> Anybody else think so? Or, do you have tools you've already written for
> this? Seems like a common need (we also need that, and have started tools
> for it internally).
>
> Ian
>
> On Apr 9, 2012, at 11:56 AM, Andrew Purtell wrote:
>
> Manual schema changes via one-off shell scripts.
>
>
> What I would like to do is write code that gets the HTD, checks if
> all of the schema structure and features are as they should be, and, if
> not, makes the necessary modifications without taking the table offline.(I
> typically write code like that which does offlining first. In practice, it
> creates the table if it is missing in some test environment, later it is
> disabled.) It could be possible to update HTD and HCD attributes without
> offlining, possibly even to add CFs. I wouldn't expect all admin actions
> could be accomplished without offlining.
>
>
> Best regards,
>
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
>
>
> ----- Original Message -----
> From: Ian Varley <ivarley@salesforce.com<mailto:ivarley@salesforce.com>>
> To: "user@hbase.apache.org<mailto:user@hbase.apache.org>" <
> user@hbase.apache.org<mailto:user@hbase.apache.org>>
> Cc:
> Sent: Monday, April 9, 2012 9:08 AM
> Subject: Schema Updates: what do you do today?
>
> All:
>
> I'm doing a little research into various ways to apply schema modifications
> to an HBase cluster. Anybody care to share with the list what you
> currently do?
> E.g.
>
> - Connect via the HBase shell and manually issue commands ("create",
> "disable", "alter", etc.)
> - Write one-off scripts that do the above
> - Write tools that read from a static schema definition and then apply
> changes
> to a cluster (e.g. using HBaseAdmin)
>
> etc. My supposition is that some additional tooling in this area, to
> consolidate
> stuff everybody already does on their own, might be helpful. In light of
> recent
> discussions on the dev list about various ways to alter the schema on a
> running
> cluster, it seems like this area is still a bit of a "wild west" in
> the HBase community, both in how HBase works and in what people do in
> practice.
>
> What do you do today for schema changes, and what would you like to do in
> an
> ideal world?
>
> Thanks,
> Ian
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message