Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 400381056E for ; Mon, 22 Jul 2013 22:52:50 +0000 (UTC) Received: (qmail 90722 invoked by uid 500); 22 Jul 2013 22:52:49 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 90661 invoked by uid 500); 22 Jul 2013 22:52:49 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 90592 invoked by uid 500); 22 Jul 2013 22:52:49 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 90572 invoked by uid 99); 22 Jul 2013 22:52:49 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Jul 2013 22:52:49 +0000 Date: Mon, 22 Jul 2013 22:52:49 +0000 (UTC) From: "Xuefu Zhang (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-4913) Put deterministic ordering in the top-K ngrams output of UDF context_ngrams() MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-4913: ------------------------------ Status: Patch Available (was: Open) > Put deterministic ordering in the top-K ngrams output of UDF context_ngrams() > ----------------------------------------------------------------------------- > > Key: HIVE-4913 > URL: https://issues.apache.org/jira/browse/HIVE-4913 > Project: Hive > Issue Type: Improvement > Components: UDF > Affects Versions: 0.11.0, 0.10.0 > Reporter: Xuefu Zhang > Assignee: Xuefu Zhang > Priority: Minor > Fix For: 0.12.0 > > Attachments: HIVE-4913.patch > > > Currently UDF context_ngrams() output top-K ngrams in the order of descending frequency. When there are ties, i.e., phrases with same ngram value, the order is indeterministic. Tie breaker is needed to break the ties, so that the output is deterministic. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira