flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: A small Project I've been working on
Date Wed, 01 Apr 2015 08:29:43 GMT
For the Ruby interpreter on Flink, I suggest to implement this in Rust.

To implement a system that analyzes data at "web scale", what would be a
better language than one used to implement the engine of a "web browser".

On Wed, Apr 1, 2015 at 10:05 AM, Stephan Ewen <sewen@apache.org> wrote:

> It April, 1st, right?
>
> On Wed, Apr 1, 2015 at 9:47 AM, Gyula Fóra <gyfora@apache.org> wrote:
>
>> Amazing! :)
>>
>> On Wed, Apr 1, 2015 at 9:41 AM, <fhueske@gmail.com> wrote:
>>
>> > My ruby skills are a bit rust(y) but I’d love to contribute.
>> >
>> >
>> > Can you point me to a repository that I can fork?
>> >
>> >
>> >
>> >
>> >
>> >
>> > From: Till Rohrmann
>> > Sent: ‎Wednesday‎, ‎1‎. ‎April‎, ‎2015 ‎09‎:‎29
>> > To: dev@flink.apache.org
>> >
>> >
>> >
>> >
>> >
>> > Where can I start contributing. I've got the feeling that it will be
>> > inherently faster than everything else which is out there.
>> > On Apr 1, 2015 9:18 AM, "Ufuk Celebi" <uce@apache.org> wrote:
>> >
>> > > Little side projects ftw. Very nice :-)
>> > >
>> > > Can you give some points on how this works internally? Is it making
>> use
>> > of
>> > > anything generic from the Python API pull request?
>> > >
>> > > On Wednesday, April 1, 2015, Márton Balassi <balassi.marton@gmail.com
>> >
>> > > wrote:
>> > >
>> > > > Woot!
>> > > >
>> > > > On Wed, Apr 1, 2015 at 9:01 AM, Aljoscha Krettek <
>> aljoscha@apache.org
>> > > > <javascript:;>>
>> > > > wrote:
>> > > >
>> > > > > Right now, runtime is roughly thrice that of equivalent java
>> > programs.
>> > > > > But I plan on bringing that to the same ballpark using code
>> > > > > generation.
>> > > > >
>> > > > > On Wed, Apr 1, 2015 at 8:54 AM, Fabian Hueske <fhueske@gmail.com
>> > > > <javascript:;>> wrote:
>> > > > > > :-D
>> > > > > > This is awesome!
>> > > > > >
>> > > > > > Do you have some performance numbers?
>> > > > > > On Apr 1, 2015 8:43 AM, "Aljoscha Krettek" <aljoscha@apache.org
>> > > > <javascript:;>> wrote:
>> > > > > >
>> > > > > >> Hi,
>> > > > > >> I've been working on a little side project in my free
time:
>> Ruby
>> > on
>> > > > > >> Flink (RoF). This should finally allow us to tap into
the whole
>> > web
>> > > > > >> developer ruby world. The design is also flexible enough
to
>> easily
>> > > > > >> port this to node.js.
>> > > > > >>
>> > > > > >> The code is not yet in shape to be made public but this
is a
>> small
>> > > > > >> preview of what the API looks like:
>> > > > > >>
>> > > > > >> input = env.read_text_file("/some/path")
>> > > > > >>
>> > > > > >> words = input.flatMap do |line|
>> > > > > >>   parts = line.split(/\W+/)
>> > > > > >>   parts.each do |word|
>> > > > > >>     word, 1
>> > > > > >>   end
>> > > > > >> end
>> > > > > >>
>> > > > > >> counts = words.reduce do |left, right|
>> > > > > >>   left(1), left(1) + right(2)
>> > > > > >> end
>> > > > > >>
>> > > > > >> counts.print()
>> > > > > >>
>> > > > > >> env.execute!()
>> > > > > >>
>> > > > > >> Cheers,
>> > > > > >> Aljoscha
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message