Return-Path: X-Original-To: apmail-sqoop-dev-archive@www.apache.org Delivered-To: apmail-sqoop-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B0D7E10B0E for ; Mon, 1 Dec 2014 23:24:13 +0000 (UTC) Received: (qmail 75011 invoked by uid 500); 1 Dec 2014 23:24:13 -0000 Delivered-To: apmail-sqoop-dev-archive@sqoop.apache.org Received: (qmail 74971 invoked by uid 500); 1 Dec 2014 23:24:13 -0000 Mailing-List: contact dev-help@sqoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@sqoop.apache.org Delivered-To: mailing list dev@sqoop.apache.org Received: (qmail 74957 invoked by uid 99); 1 Dec 2014 23:24:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Dec 2014 23:24:13 +0000 Date: Mon, 1 Dec 2014 23:24:13 +0000 (UTC) From: "Jarek Jarcec Cecho (JIRA)" To: dev@sqoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (SQOOP-1616) Sqoop data type to Kite Avro data type convert MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/SQOOP-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230672#comment-14230672 ] Jarek Jarcec Cecho commented on SQOOP-1616: ------------------------------------------- This is slightly off-topic, but I wanted to add my thoughts. The original design that drove IDF is to decouple the connector code and it's internal data representation. We worked with assumption that there will be exactly one internal representation that each connector will use (in memory). One connector can of course support multiple output formats, but we did not intended to use the IDF infrastructure to do such conversions and hence the single {{getIDF()}} call in {{SqoopConnector}}. Having said that I believe that Kite internally uses Avro objects to represents data in memory and hence using Avro IDF might make sense. > Sqoop data type to Kite Avro data type convert > ---------------------------------------------- > > Key: SQOOP-1616 > URL: https://issues.apache.org/jira/browse/SQOOP-1616 > Project: Sqoop > Issue Type: Sub-task > Components: connectors > Reporter: Qian Xu > Assignee: Qian Xu > Priority: Minor > Fix For: 1.99.5 > > > Should add more data type convert support -- This message was sent by Atlassian JIRA (v6.3.4#6332)