Return-Path: X-Original-To: apmail-sqoop-dev-archive@www.apache.org Delivered-To: apmail-sqoop-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8759D17DF7 for ; Thu, 9 Oct 2014 06:25:24 +0000 (UTC) Received: (qmail 12649 invoked by uid 500); 9 Oct 2014 06:25:24 -0000 Delivered-To: apmail-sqoop-dev-archive@sqoop.apache.org Received: (qmail 12613 invoked by uid 500); 9 Oct 2014 06:25:24 -0000 Mailing-List: contact dev-help@sqoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@sqoop.apache.org Delivered-To: mailing list dev@sqoop.apache.org Received: (qmail 12594 invoked by uid 99); 9 Oct 2014 06:25:24 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Oct 2014 06:25:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of s28sweet@gmail.com designates 209.85.217.181 as permitted sender) Received: from [209.85.217.181] (HELO mail-lb0-f181.google.com) (209.85.217.181) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Oct 2014 06:24:58 +0000 Received: by mail-lb0-f181.google.com with SMTP id l4so495907lbv.26 for ; Wed, 08 Oct 2014 23:24:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=x7u2HZZIu4DNwGWHWAOT9u193n8tYi9WSNd+YmocBDQ=; b=i6ggPMAPsKgtK2AL4qRvn7mEOJDKI1kez2MPkF43hEDPkjRC5yak0rD7o1DztZ1xJQ dagkYxm49abyFCCbBPgKlCX1Vzz/oBz3QmWWhWrcotbn8mJs9d52uLVP6M7keSdDmUGN lh0rP5R6q3lbRCQ5iASuHDPQzAsSdCJHWqWkEvvENbK/vFHUvmaS6i0fngUEh9yLIbEB Xf4zp+REZiFQ5pb/ow5KD0M1Cjy5MJfpwuGBMjAE5N7Wh6vPYE8uusCKW46/bmPcNtY5 o9eFkSiq4Cp7kfv7ZdJbo0EuA1gD1avK2JSy8fddidcTEBlW/uRenjS17NKT3ka8NU9n toQQ== X-Received: by 10.152.44.136 with SMTP id e8mr16201692lam.21.1412835897051; Wed, 08 Oct 2014 23:24:57 -0700 (PDT) MIME-Version: 1.0 Received: by 10.114.5.34 with HTTP; Wed, 8 Oct 2014 23:24:36 -0700 (PDT) In-Reply-To: References: From: shakun grover Date: Thu, 9 Oct 2014 11:54:36 +0530 Message-ID: Subject: Re: Sqoop2:Duplicate Column Name in Multiple Tables Import To: dev@sqoop.apache.org Content-Type: multipart/alternative; boundary=089e0160a8b2c510ee0504f77dd0 X-Virus-Checked: Checked by ClamAV on apache.org --089e0160a8b2c510ee0504f77dd0 Content-Type: text/plain; charset=UTF-8 Thanks Abe. I have opened a bug in Jira i.e. https://issues.apache.org/jira/browse/SQOOP-1572 On Thu, Oct 9, 2014 at 11:31 AM, Abraham Elmahrek wrote: > Got it. This looks like a legitimate bug. Would you mind filing a Jira > describing what you're seeing at https://issues.apache.org/jira. We're > actively developing Sqoop2 and it's still in what I'd consider its > developmental stages. I sent out a potential roadmap about a week ago, so > hopefully Sqoop2 will be feature packed and more stable in the months to > come. > > -Abe > > On Wed, Oct 8, 2014 at 10:51 PM, shakun grover wrote: > > > Even with"AS" operator, it is not working: > > > > *Job:* > > Name: > > > > Database configuration > > > > Schema name: > > Table name: > > Table SQL statement: select list.action,list.description,list.id AS > > listId,cl.class,cl.id AS classId from test.action_list AS > list,test.class > > AS cl WHERE ${CONDITIONS} > > Table column names: > > Partition column name: listId > > Nulls in partition column: > > Boundary query: > > > > Output configuration > > > > Storage type: > > 0 : HDFS > > Choose: 0 > > Output format: > > 0 : TEXT_FILE > > 1 : SEQUENCE_FILE > > Choose: 0 > > Output directory: /tmp/multitables/5 > > > > *LOGS:* > > org.apache.sqoop.common.SqoopException: SCHEMA_0002:Duplicate column > name - > > Column: FixedPoint{name=id,nullable=null,byteSize=null,unsigned=null} > > at org.apache.sqoop.schema.Schema.addColumn(Schema.java:88) > > at > > > > > org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer.getSchema(GenericJdbcImportInitializer.java:99) > > at > > > > > org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer.getSchema(GenericJdbcImportInitializer.java:40) > > at org.apache.sqoop.framework.JobManager.submit(JobManager.java:388) > > at > > > > > org.apache.sqoop.handler.SubmissionRequestHandler.submissionSubmit(SubmissionRequestHandler.java:152) > > at > > > > > org.apache.sqoop.handler.SubmissionRequestHandler.handleActionEvent(SubmissionRequestHandler.java:122) > > at > > > > > org.apache.sqoop.handler.SubmissionRequestHandler.handleEvent(SubmissionRequestHandler.java:75) > > at > > > > > org.apache.sqoop.server.v1.SubmissionServlet.handlePostRequest(SubmissionServlet.java:44) > > at > > > > > org.apache.sqoop.server.SqoopProtocolServlet.doPost(SqoopProtocolServlet.java:63) > > > > > > > > On Thu, Oct 9, 2014 at 4:49 AM, Abraham Elmahrek > wrote: > > > > > Sorry, > > > > > > I just noticed I didn't add the "AS" operator: "SELECT tbl1.name, > > > tb1.description, tbl1.id AS t1_id, tbl2.class tbl2.id AS t2_id FROM > > > test.table_1 as tbl1, test.table_2 as tbl2 WHERE ${CONDITIONS}". > > > > > > On Wed, Oct 8, 2014 at 12:22 PM, Abraham Elmahrek > > > wrote: > > > > > > > MySQL should support the "AS" operator. Could you try that? > > > > > > > > "SELECT tbl1.name, tb1.description, tbl1.id, tbl2.class tbl2.id FROM > > > > test.table_1 as tbl1, test.table_2 as tbl2 WHERE ${CONDITIONS}". > > > > > > > > On Wed, Oct 8, 2014 at 4:16 AM, shakun grover > > > wrote: > > > > > > > >> Hi All, > > > >> > > > >> I want to import multiple tables' data to HDFS. But while doing > this, > > if > > > >> same column name is there in more than one table. It gives me > > exception > > > >> while starting the job. > > > >> > > > >> *Job:* > > > >> Name: testMultipleTables > > > >> > > > >> Database configuration > > > >> > > > >> Schema name: > > > >> Table name: > > > >> Table SQL statement: select tbl1.name , tbl1.description, tbl1.id, > > > >> tbl2.class, tbl2.id from test.table_1 as tbl1, test.table_2 as tbl2 > > > WHERE > > > >> ${CONDITIONS} > > > >> Table column names: > > > >> Partition column name: tbl1.id > > > >> Nulls in partition column: > > > >> Boundary query: > > > >> > > > >> Output configuration > > > >> > > > >> Storage type: > > > >> 0 : HDFS > > > >> Choose: 0 > > > >> Output format: > > > >> 0 : TEXT_FILE > > > >> 1 : SEQUENCE_FILE > > > >> Choose: 0 > > > >> Output directory: /tmp/multitables/3 > > > >> > > > >> *Exception while starting the job on the console:* > > > >> Exception has occurred during processing command > > > >> Server has returned exception: Exception: java.lang.Throwable > Message: > > > >> GENERIC_JDBC_CONNECTOR_0002:Unable to execute the SQL statement > > > >> > > > >> *Exception in the logs:* > > > >> > > > >> Caused by: > com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: > > > >> Duplicate column name 'id' > > > >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > > Method) > > > >> > > > >> Could you please tell me a solution for this? > > > >> -- > > > >> Thanks & Regards, > > > >> Shakun Grover > > > >> > > > > > > > > > > > > > > > > > > > -- > > Thanks & Regards, > > Shakun Grover > > > -- Thanks & Regards, Shakun Grover --089e0160a8b2c510ee0504f77dd0--