flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eranga Heshan <eranga....@gmail.com>
Subject Distribute crawling of a URL list using Flink
Date Mon, 14 Aug 2017 03:09:15 GMT
Hi all,

I am fairly new to Flink. I have this project where I have a list of URLs
(In one node) which need to be crawled distributedly. Then for each URL, I
need the serialized crawled result to be written to a single text file.

I want to know if there are similar projects which I can look into or an
idea on how to implement this.

Thanks & Regards,



Eranga Heshan
*Undergraduate*
Computer Science & Engineering
University of Moratuwa
Mobile:  +94 71 138 2686 <%2B94%2071%20552%202087>
Email: eranga.h.n@gmail.com
<https://www.facebook.com/erangaheshan>   <https://twitter.com/erangaheshan>
   <https://www.linkedin.com/in/erangaheshan>

Mime
View raw message