incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bill Graham <>
Subject Re: HCatalog feature wish list
Date Fri, 29 Apr 2011 20:35:57 GMT
Thanks for the great responses. Glad to know these things are already being
worked on.

 Devaraj: HCatalog will soon have a tool that can import data schema to the
> metadata store. At Yahoo!, the plan is to use this tool to migrate all old
> data. All new data should be directly registered in HCatalog by the data
> producers. Would this suffice?

A one-time load would suffice, provided there was a solution to the custom
column properties functionality, since our column schemas contain some
custom fields.

We'd also need to have a way to access this HCatalog data from Python Hadoop
streaming jobs. I see Hadoop streaming support is not yet available, but is
planned. Any idea how high on the roadmap streaming support falls? Just
trying to get a sense for how far out this functionality it.

On Fri, Apr 29, 2011 at 12:10 PM, Devaraj Das <> wrote:
> Sent from my iPhone
> On Apr 29, 2011, at 11:35 AM, "Carl Steinbach" <> wrote:
> Hi Devaraj,
>> - Web UI
>> Are there any know web UIs (or plans for one) to expose and even
>> modify HCatalog data? We'd like to build a web UI that would help with
>> data discovery. IIRC, facebook had something similar at one point.
>> Devaraj: At Yahoo!, there is some internal effort going on in this
>> direction.
> Is Y! planning to open-source this work? If so, do you have any idea when
> can expect that to happen?
> Thanks.
> Carl
> Don't know for sure since the work is happening in a different group. I'll
> touch base with them and get back..

View raw message