Mailing-List: contact chukwa-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Message-ID: <4B9EAEB6.7020200@mustardgrain.com>
Date: Mon, 15 Mar 2010 15:03:34 -0700
From: Kirk True <kirk@mustardgrain.com>
User-Agent: Thunderbird 2.0.0.23 (Macintosh/20090812)
MIME-Version: 1.0
To: chukwa-user@hadoop.apache.org
Subject: Re: How to set up HDFS -> MySQL from trunk?
References: <C7C3EAFF.7116%eyang@yahoo-inc.com>
In-Reply-To: <C7C3EAFF.7116%eyang@yahoo-inc.com>
Content-Type: multipart/alternative;
 boundary="------------060806070509090409030606"

This is a multi-part message in MIME format.
--------------060806070509090409030606
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi Eric,

Any notion as to the ETA for completion of the migration?

Thanks,
Kirk

Eric Yang wrote:
> Hi Kirk,
>
> I am working on a design which removes MySQL from Chukwa.  I am making this
> departure from MySQL because MDL framework was for prototype purpose.  It
> will not scale in production system where Chukwa could be host on large
> hadoop cluster.  HICC will serve data directly from HDFS in the future.
>
> Meanwhile, the dbAdmin.sh from Chukwa 0.3 is still compatible with trunk
> version of Chukwa.  You can load ChukwaRecords using
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader class or mdl.sh from
> Chukwa 0.3.
>
> MetricDataLoader class will be mark as deprecated, and it will not be
> supported once we make transition to Avro + Tfile.
>
> Regards,
> Eric
>
> On 3/15/10 11:56 AM, "Kirk True" <kirk@mustardgrain.com> wrote:
>
>   
>> Hi all,
>>
>> I recently switched to trunk as I was experiencing a lot of issues with
>> 0.3.0. In 0.3.0, there was a dbAdmin.sh script that would run and try to
>> stick data in MySQL from HDFS. However, that script is gone and when I
>> run the system as built from trunk, nothing is ever populated in the
>> database. Where are the instructions for setting up the HDFS -> MySQL
>> data migration for HICC?
>>
>> Thanks,
>> Kirk
>>     
>
>   

--------------060806070509090409030606
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Hi Eric,<br>
<br>
Any notion as to the ETA for completion of the migration?<br>
<br>
Thanks,<br>
Kirk<br>
<br>
Eric Yang wrote:
<blockquote cite="mid:C7C3EAFF.7116%25eyang@yahoo-inc.com" type="cite">
  <pre wrap="">Hi Kirk,

I am working on a design which removes MySQL from Chukwa.  I am making this
departure from MySQL because MDL framework was for prototype purpose.  It
will not scale in production system where Chukwa could be host on large
hadoop cluster.  HICC will serve data directly from HDFS in the future.

Meanwhile, the dbAdmin.sh from Chukwa 0.3 is still compatible with trunk
version of Chukwa.  You can load ChukwaRecords using
org.apache.hadoop.chukwa.dataloader.MetricDataLoader class or mdl.sh from
Chukwa 0.3.

MetricDataLoader class will be mark as deprecated, and it will not be
supported once we make transition to Avro + Tfile.

Regards,
Eric

On 3/15/10 11:56 AM, "Kirk True" <a class="moz-txt-link-rfc2396E" href="mailto:kirk@mustardgrain.com">&lt;kirk@mustardgrain.com&gt;</a> wrote:

  </pre>
  <blockquote type="cite">
    <pre wrap="">Hi all,

I recently switched to trunk as I was experiencing a lot of issues with
0.3.0. In 0.3.0, there was a dbAdmin.sh script that would run and try to
stick data in MySQL from HDFS. However, that script is gone and when I
run the system as built from trunk, nothing is ever populated in the
database. Where are the instructions for setting up the HDFS -&gt; MySQL
data migration for HICC?

Thanks,
Kirk
    </pre>
  </blockquote>
  <pre wrap=""><!---->
  </pre>
</blockquote>
</body>
</html>

--------------060806070509090409030606--