flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Viktor Rosenfeld <viktor.rosenf...@tu-berlin.de>
Subject Re: Compression of network traffic
Date Wed, 26 Nov 2014 21:58:58 GMT
Hi Stephan,

Compressing network buffers as a blob is probably the fastest/easiest way to
achieve some measure of results.

But I wonder if it would be possible to implement some operations on the
serialized compressed form. For example, groupings and joins should be easy
to implement. If the field is not accessed in the UDF then it won't have to
be deserialized.

A complication would be how the compression scheme is passed on to the next
nodes in the computation chain.


View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Compression-of-network-traffic-tp2568p2637.html
Sent from the Apache Flink (Incubator) Mailing List archive. mailing list archive at Nabble.com.

View raw message