hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4913) Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()
Date Thu, 08 Aug 2013 00:10:49 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732982#comment-13732982
] 

Ashutosh Chauhan commented on HIVE-4913:
----------------------------------------

Patch contains some changes from other diff. Can you clean that up? Patch looks good.
                
> Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-4913
>                 URL: https://issues.apache.org/jira/browse/HIVE-4913
>             Project: Hive
>          Issue Type: Improvement
>          Components: UDF
>    Affects Versions: 0.10.0, 0.11.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>            Priority: Minor
>             Fix For: 0.12.0
>
>         Attachments: HIVE-4913.patch
>
>
> Currently UDF context_ngrams() output top-K ngrams in the order of descending frequency.
When there are ties, i.e., phrases with same ngram value, the order is indeterministic. Tie
breaker is needed to break the ties, so that the output is deterministic.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message