flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Sorting of fields
Date Thu, 05 Feb 2015 08:24:03 GMT
Based on this, we should also be able to implement a global top-k, which
has come up as a frequent requirement.

On Wed, Feb 4, 2015 at 2:55 PM, Fabian Hueske <fhueske@gmail.com> wrote:

> I just merged support for local output sorting yesterday :-)
> This allows to sort the data before it is given to the OutputFormat.
>
> It is done like this:
> myData.write(myOF).sortLocalOutput(1, Order.ASCENDING);
>
> See the programming guide for details (only in master, not online).
>
> Full sorting can be done with a DOP=1 data sink.
> Full parallel sorting is not supported yet (requires range partitioning and
> data stats for good partitioning bins).
>
> Best, Fabian
>
> 2015-02-04 14:38 GMT+01:00 Timo Walther <twalthr@apache.org>:
>
> > Hey,
> >
> > is it correct that we currently do not support sorting without any
> > grouping? I had this question by 2 users in the last weeks and now I also
> > need this functionality.
> >
> >
> > Is it possible to sort e.g. a word count result Tuple2<String, Integer>
> by
> > count?
> >
> >
> > Regards,
> > Timo
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message