flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Viktor Rosenfeld <viktor.rosenf...@tu-berlin.de>
Subject Re: Compression of network traffic
Date Tue, 25 Nov 2014 10:26:35 GMT

A codec like Snappy would work on an entire network buffer as one big blob,
right? I was more thinking along the lines of compressing individual tuples
fields by treating them as columns, e.g., using frame-of-reference encoding
and bit backing. Compression on tuple fields should yield much better
results than compressing the entire blob. Given that Flink controls the
serialization process this should be transparent to other layers in the
code. Not sure it is worth the effort though.


View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Compression-of-network-traffic-tp2568p2607.html
Sent from the Apache Flink (Incubator) Mailing List archive. mailing list archive at Nabble.com.

View raw message