hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1036) An API Specification for Sqoop
Date Thu, 15 Oct 2009 17:16:31 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766128#action_12766128

Aaron Kimball commented on MAPREDUCE-1036:

BigDecimalSerializer is used from within SqoopRecord classes auto-generated by Sqoop. Therefore
it'll be used by client programs. Under the conventions outlined above, that means it belongs
in o.a.h.sqoop.lib.

If it has broader applicability than Sqoop, then it may make sense to promote it elsewhere.
But it's not a Writable in-and-of-itself. (SqoopRecord uses BigDecimalSerializer to de/serialize
BigDecimal fields within its own readFields/write methods.) To my knowledge, Hadoop doesn't
currently have a policy with regard to which package external serializers go in. If you think
it'd be more generally useful, I'm happy to move it into common. Do you think it should just
go in o.a.h.io?

> An API Specification for Sqoop
> ------------------------------
>                 Key: MAPREDUCE-1036
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1036
>             Project: Hadoop Map/Reduce
>          Issue Type: Task
>          Components: contrib/sqoop
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: sqoop-reference.txt
> Over the last several months, Sqoop has evolved to a state that is functional and has
room for extensions. Developing extensions requires a stable API and documentation. I am attaching
to this ticket a description of Sqoop's design and internal APIs, which include some open
questions. I would like to solicit input on the design regarding these open questions and
standardize the API.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message