Mailing-List: contact user-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@crunch.apache.org
MIME-Version: 1.0
Date: Tue, 23 Jun 2015 21:52:02 +0900
Message-ID: 
 <CA+25w9-jkXhbZA_5FW=GNDYdp5RH08KRSb-u=jXF6xz=cBpDbA@mail.gmail.com>
Subject: secondary sort in crunch on spark.
From: Kidong Lee <mykidong@gmail.com>
To: user@crunch.apache.org
Content-Type: multipart/alternative; boundary=089e0122e90c4e62e005192edba6

--089e0122e90c4e62e005192edba6
Content-Type: text/plain; charset=UTF-8

Hi,

I have been using spark to implement our recommendation algorithm, for
which it was hard to get secondary sort by value, thus, I have implemented
this algorithm with the help of hive.
I think, spark does not support secondary sort yet.

I have recently implemented the same recommendation algorithm in crunch
running on spark with using crunch secondary sort API.

I am wondering how to implement secondary sort in crunch running on spark.

Anybody can give me some explanations about the implementation of secondary
sort in crunch spark?

thanks,

- Kidong.

--089e0122e90c4e62e005192edba6
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div><div>Hi,<br><br></div>I have been usin=
g spark to implement our recommendation algorithm, for which it was hard to=
 get secondary sort by value, thus, I have implemented this algorithm with =
the help of hive.<br>I think, spark does not support secondary sort yet.<br=
><br>I have recently implemented the same recommendation algorithm in crunc=
h running on spark with using crunch secondary sort API.<br><br></div>I am =
wondering how to implement secondary sort in crunch running on spark.<br><b=
r></div>Anybody can give me some explanations about the implementation of s=
econdary sort in crunch spark?<br><br></div>thanks,<br><br></div>- Kidong.<=
br><div><div><div><div><br></div></div></div></div></div>

--089e0122e90c4e62e005192edba6--