sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shakun grover <s28sw...@gmail.com>
Subject Re: Sqoop2:Duplicate Column Name in Multiple Tables Import
Date Thu, 09 Oct 2014 06:24:36 GMT
Thanks Abe.
I have opened a bug in Jira i.e.
https://issues.apache.org/jira/browse/SQOOP-1572

On Thu, Oct 9, 2014 at 11:31 AM, Abraham Elmahrek <abe@cloudera.com> wrote:

> Got it. This looks like a legitimate bug. Would you mind filing a Jira
> describing what you're seeing at https://issues.apache.org/jira. We're
> actively developing Sqoop2 and it's still in what I'd consider its
> developmental stages. I sent out a potential roadmap about a week ago, so
> hopefully Sqoop2 will be feature packed and more stable in the months to
> come.
>
> -Abe
>
> On Wed, Oct 8, 2014 at 10:51 PM, shakun grover <s28sweet@gmail.com> wrote:
>
> > Even with"AS" operator, it is not working:
> >
> > *Job:*
> > Name:
> >
> > Database configuration
> >
> > Schema name:
> > Table name:
> > Table SQL statement: select list.action,list.description,list.id AS
> > listId,cl.class,cl.id AS classId from test.action_list AS
> list,test.class
> > AS cl WHERE ${CONDITIONS}
> > Table column names:
> > Partition column name: listId
> > Nulls in partition column:
> > Boundary query:
> >
> > Output configuration
> >
> > Storage type:
> >   0 : HDFS
> > Choose: 0
> > Output format:
> >   0 : TEXT_FILE
> >   1 : SEQUENCE_FILE
> > Choose: 0
> > Output directory: /tmp/multitables/5
> >
> > *LOGS:*
> > org.apache.sqoop.common.SqoopException: SCHEMA_0002:Duplicate column
> name -
> > Column: FixedPoint{name=id,nullable=null,byteSize=null,unsigned=null}
> > at org.apache.sqoop.schema.Schema.addColumn(Schema.java:88)
> > at
> >
> >
> org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer.getSchema(GenericJdbcImportInitializer.java:99)
> > at
> >
> >
> org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer.getSchema(GenericJdbcImportInitializer.java:40)
> > at org.apache.sqoop.framework.JobManager.submit(JobManager.java:388)
> > at
> >
> >
> org.apache.sqoop.handler.SubmissionRequestHandler.submissionSubmit(SubmissionRequestHandler.java:152)
> > at
> >
> >
> org.apache.sqoop.handler.SubmissionRequestHandler.handleActionEvent(SubmissionRequestHandler.java:122)
> > at
> >
> >
> org.apache.sqoop.handler.SubmissionRequestHandler.handleEvent(SubmissionRequestHandler.java:75)
> > at
> >
> >
> org.apache.sqoop.server.v1.SubmissionServlet.handlePostRequest(SubmissionServlet.java:44)
> > at
> >
> >
> org.apache.sqoop.server.SqoopProtocolServlet.doPost(SqoopProtocolServlet.java:63)
> >
> >
> >
> > On Thu, Oct 9, 2014 at 4:49 AM, Abraham Elmahrek <abe@cloudera.com>
> wrote:
> >
> > > Sorry,
> > >
> > > I just noticed I didn't add the "AS" operator: "SELECT tbl1.name,
> > > tb1.description, tbl1.id AS t1_id, tbl2.class tbl2.id AS t2_id FROM
> > > test.table_1 as tbl1, test.table_2 as tbl2 WHERE ${CONDITIONS}".
> > >
> > > On Wed, Oct 8, 2014 at 12:22 PM, Abraham Elmahrek <abe@cloudera.com>
> > > wrote:
> > >
> > > > MySQL should support the "AS" operator. Could you try that?
> > > >
> > > > "SELECT tbl1.name, tb1.description, tbl1.id, tbl2.class tbl2.id FROM
> > > > test.table_1 as tbl1, test.table_2 as tbl2 WHERE ${CONDITIONS}".
> > > >
> > > > On Wed, Oct 8, 2014 at 4:16 AM, shakun grover <s28sweet@gmail.com>
> > > wrote:
> > > >
> > > >> Hi All,
> > > >>
> > > >> I want to import multiple tables' data to HDFS. But while doing
> this,
> > if
> > > >> same column name is there in more than one table. It gives me
> > exception
> > > >> while starting the job.
> > > >>
> > > >> *Job:*
> > > >> Name: testMultipleTables
> > > >>
> > > >> Database configuration
> > > >>
> > > >> Schema name:
> > > >> Table name:
> > > >> Table SQL statement: select tbl1.name , tbl1.description, tbl1.id,
> > > >> tbl2.class, tbl2.id from test.table_1 as tbl1, test.table_2 as tbl2
> > > WHERE
> > > >> ${CONDITIONS}
> > > >> Table column names:
> > > >> Partition column name: tbl1.id
> > > >> Nulls in partition column:
> > > >> Boundary query:
> > > >>
> > > >> Output configuration
> > > >>
> > > >> Storage type:
> > > >>   0 : HDFS
> > > >> Choose: 0
> > > >> Output format:
> > > >>   0 : TEXT_FILE
> > > >>   1 : SEQUENCE_FILE
> > > >> Choose: 0
> > > >> Output directory: /tmp/multitables/3
> > > >>
> > > >> *Exception while starting the job on the console:*
> > > >> Exception has occurred during processing command
> > > >> Server has returned exception: Exception: java.lang.Throwable
> Message:
> > > >> GENERIC_JDBC_CONNECTOR_0002:Unable to execute the SQL statement
> > > >>
> > > >> *Exception in the logs:*
> > > >>
> > > >> Caused by:
> com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
> > > >> Duplicate column name 'id'
> > > >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> > > >>
> > > >> Could you please tell me a solution for this?
> > > >> --
> > > >> Thanks & Regards,
> > > >> Shakun Grover
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Shakun Grover
> >
>



-- 
Thanks & Regards,
Shakun Grover

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message