Mailing-List: contact dev-help@sqoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@sqoop.apache.org
Received-SPF: pass (athena.apache.org: domain of abe@cloudera.com designates
 209.85.218.54 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEap9pWEUeEr09FCCDPvHM4H4B=0rSn+rpBJvX+JwwCsiVr3ow@mail.gmail.com>
References: 
 <CAEap9pXdk9cq3OMdEWtcW0gGD5=DNZ1uq49mOUpZsxzjpcUS9A@mail.gmail.com>
 <CAOvM-cir2Cq9UqKp41XQDLm3ZQH4mYX6yCMz4GhhOdrM39qL+A@mail.gmail.com>
 <CAOvM-cg2xsjopi7ppn9pc+8DmvhyMrXKr9FDrOfoNg4BFQbZ_w@mail.gmail.com>
 <CAEap9pVRH29bgpJV5quFgivGtV3wS4oNGj+Nkf08mUo_Ck73Cw@mail.gmail.com>
 <CAOvM-ciiQ5hN5LUjjZts4eTyCPhXeCKeXUtnQOdDVPho6SNB9Q@mail.gmail.com>
 <CAEap9pWEUeEr09FCCDPvHM4H4B=0rSn+rpBJvX+JwwCsiVr3ow@mail.gmail.com>
From: Abraham Elmahrek <abe@cloudera.com>
Date: Thu, 9 Oct 2014 00:03:41 -0700
Message-ID: 
 <CAOvM-cgefzt5BBrGSG7-Eahq_2ex_M32BorXqbup1yTh3uwuuw@mail.gmail.com>
Subject: Re: Sqoop2:Duplicate Column Name in Multiple Tables Import
To: "dev@sqoop.apache.org" <dev@sqoop.apache.org>
Content-Type: multipart/alternative; boundary=001a1133e0e489b1d00504f809e9

--001a1133e0e489b1d00504f809e9
Content-Type: text/plain; charset=UTF-8

Thank you!

On Wed, Oct 8, 2014 at 11:24 PM, shakun grover <s28sweet@gmail.com> wrote:

> Thanks Abe.
> I have opened a bug in Jira i.e.
> https://issues.apache.org/jira/browse/SQOOP-1572
>
> On Thu, Oct 9, 2014 at 11:31 AM, Abraham Elmahrek <abe@cloudera.com>
> wrote:
>
> > Got it. This looks like a legitimate bug. Would you mind filing a Jira
> > describing what you're seeing at https://issues.apache.org/jira. We're
> > actively developing Sqoop2 and it's still in what I'd consider its
> > developmental stages. I sent out a potential roadmap about a week ago, so
> > hopefully Sqoop2 will be feature packed and more stable in the months to
> > come.
> >
> > -Abe
> >
> > On Wed, Oct 8, 2014 at 10:51 PM, shakun grover <s28sweet@gmail.com>
> wrote:
> >
> > > Even with"AS" operator, it is not working:
> > >
> > > *Job:*
> > > Name:
> > >
> > > Database configuration
> > >
> > > Schema name:
> > > Table name:
> > > Table SQL statement: select list.action,list.description,list.id AS
> > > listId,cl.class,cl.id AS classId from test.action_list AS
> > list,test.class
> > > AS cl WHERE ${CONDITIONS}
> > > Table column names:
> > > Partition column name: listId
> > > Nulls in partition column:
> > > Boundary query:
> > >
> > > Output configuration
> > >
> > > Storage type:
> > >   0 : HDFS
> > > Choose: 0
> > > Output format:
> > >   0 : TEXT_FILE
> > >   1 : SEQUENCE_FILE
> > > Choose: 0
> > > Output directory: /tmp/multitables/5
> > >
> > > *LOGS:*
> > > org.apache.sqoop.common.SqoopException: SCHEMA_0002:Duplicate column
> > name -
> > > Column: FixedPoint{name=id,nullable=null,byteSize=null,unsigned=null}
> > > at org.apache.sqoop.schema.Schema.addColumn(Schema.java:88)
> > > at
> > >
> > >
> >
> org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer.getSchema(GenericJdbcImportInitializer.java:99)
> > > at
> > >
> > >
> >
> org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer.getSchema(GenericJdbcImportInitializer.java:40)
> > > at org.apache.sqoop.framework.JobManager.submit(JobManager.java:388)
> > > at
> > >
> > >
> >
> org.apache.sqoop.handler.SubmissionRequestHandler.submissionSubmit(SubmissionRequestHandler.java:152)
> > > at
> > >
> > >
> >
> org.apache.sqoop.handler.SubmissionRequestHandler.handleActionEvent(SubmissionRequestHandler.java:122)
> > > at
> > >
> > >
> >
> org.apache.sqoop.handler.SubmissionRequestHandler.handleEvent(SubmissionRequestHandler.java:75)
> > > at
> > >
> > >
> >
> org.apache.sqoop.server.v1.SubmissionServlet.handlePostRequest(SubmissionServlet.java:44)
> > > at
> > >
> > >
> >
> org.apache.sqoop.server.SqoopProtocolServlet.doPost(SqoopProtocolServlet.java:63)
> > >
> > >
> > >
> > > On Thu, Oct 9, 2014 at 4:49 AM, Abraham Elmahrek <abe@cloudera.com>
> > wrote:
> > >
> > > > Sorry,
> > > >
> > > > I just noticed I didn't add the "AS" operator: "SELECT tbl1.name,
> > > > tb1.description, tbl1.id AS t1_id, tbl2.class tbl2.id AS t2_id FROM
> > > > test.table_1 as tbl1, test.table_2 as tbl2 WHERE ${CONDITIONS}".
> > > >
> > > > On Wed, Oct 8, 2014 at 12:22 PM, Abraham Elmahrek <abe@cloudera.com>
> > > > wrote:
> > > >
> > > > > MySQL should support the "AS" operator. Could you try that?
> > > > >
> > > > > "SELECT tbl1.name, tb1.description, tbl1.id, tbl2.class tbl2.id
> FROM
> > > > > test.table_1 as tbl1, test.table_2 as tbl2 WHERE ${CONDITIONS}".
> > > > >
> > > > > On Wed, Oct 8, 2014 at 4:16 AM, shakun grover <s28sweet@gmail.com>
> > > > wrote:
> > > > >
> > > > >> Hi All,
> > > > >>
> > > > >> I want to import multiple tables' data to HDFS. But while doing
> > this,
> > > if
> > > > >> same column name is there in more than one table. It gives me
> > > exception
> > > > >> while starting the job.
> > > > >>
> > > > >> *Job:*
> > > > >> Name: testMultipleTables
> > > > >>
> > > > >> Database configuration
> > > > >>
> > > > >> Schema name:
> > > > >> Table name:
> > > > >> Table SQL statement: select tbl1.name , tbl1.description, tbl1.id
> ,
> > > > >> tbl2.class, tbl2.id from test.table_1 as tbl1, test.table_2 as
> tbl2
> > > > WHERE
> > > > >> ${CONDITIONS}
> > > > >> Table column names:
> > > > >> Partition column name: tbl1.id
> > > > >> Nulls in partition column:
> > > > >> Boundary query:
> > > > >>
> > > > >> Output configuration
> > > > >>
> > > > >> Storage type:
> > > > >>   0 : HDFS
> > > > >> Choose: 0
> > > > >> Output format:
> > > > >>   0 : TEXT_FILE
> > > > >>   1 : SEQUENCE_FILE
> > > > >> Choose: 0
> > > > >> Output directory: /tmp/multitables/3
> > > > >>
> > > > >> *Exception while starting the job on the console:*
> > > > >> Exception has occurred during processing command
> > > > >> Server has returned exception: Exception: java.lang.Throwable
> > Message:
> > > > >> GENERIC_JDBC_CONNECTOR_0002:Unable to execute the SQL statement
> > > > >>
> > > > >> *Exception in the logs:*
> > > > >>
> > > > >> Caused by:
> > com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
> > > > >> Duplicate column name 'id'
> > > > >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > Method)
> > > > >>
> > > > >> Could you please tell me a solution for this?
> > > > >> --
> > > > >> Thanks & Regards,
> > > > >> Shakun Grover
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Shakun Grover
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Shakun Grover
>

--001a1133e0e489b1d00504f809e9--