incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kirk True <k...@mustardgrain.com>
Subject Re: How to set up HDFS -> MySQL from trunk?
Date Mon, 15 Mar 2010 22:03:34 GMT
Hi Eric,

Any notion as to the ETA for completion of the migration?

Thanks,
Kirk

Eric Yang wrote:
> Hi Kirk,
>
> I am working on a design which removes MySQL from Chukwa.  I am making this
> departure from MySQL because MDL framework was for prototype purpose.  It
> will not scale in production system where Chukwa could be host on large
> hadoop cluster.  HICC will serve data directly from HDFS in the future.
>
> Meanwhile, the dbAdmin.sh from Chukwa 0.3 is still compatible with trunk
> version of Chukwa.  You can load ChukwaRecords using
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader class or mdl.sh from
> Chukwa 0.3.
>
> MetricDataLoader class will be mark as deprecated, and it will not be
> supported once we make transition to Avro + Tfile.
>
> Regards,
> Eric
>
> On 3/15/10 11:56 AM, "Kirk True" <kirk@mustardgrain.com> wrote:
>
>   
>> Hi all,
>>
>> I recently switched to trunk as I was experiencing a lot of issues with
>> 0.3.0. In 0.3.0, there was a dbAdmin.sh script that would run and try to
>> stick data in MySQL from HDFS. However, that script is gone and when I
>> run the system as built from trunk, nothing is ever populated in the
>> database. Where are the instructions for setting up the HDFS -> MySQL
>> data migration for HICC?
>>
>> Thanks,
>> Kirk
>>     
>
>   

Mime
View raw message