giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gustavo Enrique Salazar Torres <gsala...@ime.usp.br>
Subject Re: MySQL Table
Date Fri, 06 Sep 2013 10:51:27 GMT
Hi Bu:
Until the interface with Gora is available you could use Apache Sqoop to
import your mysql table into HDFS and then run your Giraph job.

Cheers
Gustavo
Em 06/09/2013 04:43, "Claudio Martella" <claudio.martella@gmail.com>
escreveu:

> Hi Bu,
>
> no, currently we do not have a DBInputFormat. We have an open issue with a
> google summer of code student working on a GoraInputFormat, which supports
> also reading from RDBMs through Gora. However, if/when it will get it, it
> will not provide a rich semantic as DBInputFormat, e.g. you'll be able to
> only provide scan-like/range queries, instead of ANY query like
> DBInputFormat.
>
> I think that creating an DB[Vertex|Edge]InputFormat starting from the
> hadoop DBInputFormat should not be too hard and could prove to be a very
> useful contribution. If you think about providing an implementation, I can
> provide guidance.
>
> Best,
> Claudio
>
>
> On Fri, Sep 6, 2013 at 1:45 AM, Bu Xiao <buxiao82@gmail.com> wrote:
>
>> Hi Girapher,
>>
>>        I am currently working on algorithm that requires reading the
>> vertices from MySQL table and not from HDFS. I thought that there has to be
>> a way of reading data from SQL table since Giraph is built on top of
>> Hadoop. But I do not seem to figure this part out. Do you have a class
>> similar to the DBInputFormat in Hadoop? Thank you very much for your help.
>>
>>
>>
>
>
> --
>    Claudio Martella
>    claudio.martella@gmail.com
>

Mime
View raw message