hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Chansler (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2302) Streaming should provide an option for numerical sort of keys
Date Tue, 21 Oct 2008 22:36:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Chansler updated HADOOP-2302:
------------------------------------

    Release Note: Introduced numerical key comparison for streaming.  (was: Provides a way
to compare keys using numerical comparison. The key specification of the form -k pos1[,pos2],
is supported, where,
   *  pos is of the form f[.c][opts], where f is the number  of the key field to use, and
c is the number of the first character from  the beginning of the field. Fields and character
posns are numbered  starting with 1; a character position of zero in pos2 indicates the  field's
last character. If '.c' is omitted from pos1, it defaults to 1  (the beginning of the field);
if omitted from pos2, it defaults to 0  (the end of the field). opts are ordering options.
The supported options  are:
   *    -n, (Sort numerically)
   *    -r, (Reverse the result of comparison)
Multiple key specifications can be provided to sort on multiple key fields (in order). The
key fields are assumed to be separated using map.output.key.field.separator. Specifying only
-n as an option will make the comparator treat the all key bytes as one field.)

Introduced numerical key comparison for streaming. The key specification of the form -k pos1[,pos2],
is supported, where,
   *  pos is of the form f[.c][opts], where f is the number  of the key field to use, and
c is the number of the first character from  the beginning of the field. Fields and character
positions are numbered  starting with 1; a character position of zero in pos2 indicates the
 field's last character. If '.c' is omitted from pos1, it defaults to 1  (the beginning of
the field); if omitted from pos2, it defaults to 0  (the end of the field). opts are ordering
options. The supported options  are:
   *    -n, (Sort numerically)
   *    -r, (Reverse the result of comparison)
Multiple key specifications can be provided to sort on multiple key fields (in order). The
key fields are assumed to be separated using map.output.key.field.separator. Specifying only
-n as an option will make the comparator treat the all key bytes as one field.

[Is this user guide in the streaming user documentation?]

>  Streaming should provide an option for numerical sort of keys
> --------------------------------------------------------------
>
>                 Key: HADOOP-2302
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2302
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: contrib/streaming
>            Reporter: Lohit Vijayarenu
>            Assignee: Devaraj Das
>             Fix For: 0.19.0
>
>         Attachments: 2302-new.patch, 2302-new.patch, 2302-new1.patch, 2302-new2.patch,
2302.1.patch, 2302.3.patch
>
>
> It would be good to have an option for numerical sort of keys for streaming. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message