sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Szabolcs Vasas <va...@cloudera.com>
Subject Re: Import more than 10 million records from MySQL to HDFS
Date Wed, 04 Jan 2017 08:24:35 GMT
Hi Wenxing,

I haven't tried this scenario yet but I would be happy to test it on my
side. Can you please send me the DDL statement for creating the MySQL table
and some sample data?
Also it would be very helpful to send the details of the job you would like
to run.

Regards,
Szabolcs

On Wed, Jan 4, 2017 at 2:54 AM, wenxing zheng <wenxing.zheng@gmail.com>
wrote:

> can anyone help to advice?
>
> And I met with a problem when I set the checkColumn with updated_time, but
> currently all the updated_time are in NULL. Under this case, the Sqoop will
> fail to start the job. I think we need to support such kind of case.
>
> On Thu, Dec 29, 2016 at 9:18 AM, wenxing zheng <wenxing.zheng@gmail.com>
> wrote:
>
> > Dear all,
> >
> > Did anyone already try to import more than 10 million data from MySQL to
> > HDFS by using the Sqoop2?
> >
> > I always failed at the very beginning with various throttling settings,
> > but never made it.
> >
> > Appreciated for any advice.
> > Thanks, Wenxing
> >
>



-- 
Szabolcs Vasas
Software Engineer
<http://www.cloudera.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message