flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject Re: How do I ensure binary comparisons are being used?
Date Wed, 04 Jan 2017 12:37:06 GMT
Hi Lawrence,

comparison of binary data are mainly used by the DataSet API when sorting
large data sets or building and probing hash tables.

The DataStream API mainly benefits from Flink's custom and efficient
serialization when sending data over the wire or taking checkpoints.
There are also plans to implement a state backend based on the
serialization stack which leverages Flink's managed memory instead of
holding object on the heap (the RocksDB state backend is the current
solution to avoid this).

>From what I know, the DataStream API does not perform compare on serialized
data.

Best, Fabian



2017-01-03 7:53 GMT+01:00 ljwagerfield <lawrence@dmz.wagerfield.com>:

> Any insights on this?
>
> Thanks,
> Lawrence
>
>
>
> --
> View this message in context: http://apache-flink-user-
> mailing-list-archive.2336050.n4.nabble.com/How-do-I-ensure-
> binary-comparisons-are-being-used-tp10806p10819.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message