Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9E17F10DFB for ; Thu, 29 Aug 2013 07:46:39 +0000 (UTC) Received: (qmail 98632 invoked by uid 500); 29 Aug 2013 07:46:22 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 97925 invoked by uid 500); 29 Aug 2013 07:46:22 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 97867 invoked by uid 99); 29 Aug 2013 07:46:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Aug 2013 07:46:21 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of shekhar2581@gmail.com designates 209.85.128.169 as permitted sender) Received: from [209.85.128.169] (HELO mail-ve0-f169.google.com) (209.85.128.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Aug 2013 07:46:15 +0000 Received: by mail-ve0-f169.google.com with SMTP id db10so46614veb.14 for ; Thu, 29 Aug 2013 00:45:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=qgaLi+1WCum/bUNowo3hfq9jAG74C4FLNsqXoE6XO7w=; b=IEZK1tc6S7H4A57vAezRpn95VUJoUNbEEwHWBooAbHbkP3s8Uu8UbTkz1gFVhqm7o0 iL/YJBOX42TWiVR0QB2tyH6N+zOJjyRUhVDUNRPyokdaN0KtckM7Jp4x85t/Hjy8H7fr TuyypACI4K5IXSkUla0miWmZ3BiTrXiKrbRi+13VVVObbYnS6aN6PNYTW1aXxUUqt8/r BL5/mgCdeKLerBSqI2C0HiFnY/ceCVHnPol9v2rMrEdUY5BnZz+GuK3FSGqEafh2R9sF 76ilhUBI+m1sWjeQqFnGSDs/oTdofNT4f7kjeHgQzgV1VBYBXGIB62gDt+va0+Oxvukn SvlQ== MIME-Version: 1.0 X-Received: by 10.58.165.70 with SMTP id yw6mr1879210veb.19.1377762354915; Thu, 29 Aug 2013 00:45:54 -0700 (PDT) Received: by 10.220.168.72 with HTTP; Thu, 29 Aug 2013 00:45:54 -0700 (PDT) In-Reply-To: References: <1377707767.87327.YahooMailNeo@web162203.mail.bf1.yahoo.com> Date: Thu, 29 Aug 2013 13:15:54 +0530 Message-ID: Subject: Re: Sqoop issue related to Hadoop From: Shekhar Sharma To: user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Go inside the $HADOOP_HOME/log/user/history... Regards, Som Shekhar Sharma +91-8197243810 On Thu, Aug 29, 2013 at 10:13 AM, Hadoop Raj wrote: > Hi Kate, > > Where can I find the task attempt log? Can you specify the location please? > > > Thanks, > Raj > > On Aug 28, 2013, at 7:13 PM, Kathleen Ting wrote: > >> Raj, in addition to what Abe said, please also send the failed task attempt log >> attempt_201307041900_0463_m_000000_0 as well. >> >> Thanks, >> Kate >> >> On Wed, Aug 28, 2013 at 2:25 PM, Abraham Elmahrek wrote: >>> Hey Raj, >>> >>> It seems like the number of fields you have in your data doesn't match the >>> number of fields in your RAJ.CUSTOMERS table. >>> >>> Could you please add "--verbose" to the beginning of your argument list and >>> provide the entire contents here? >>> >>> -Abe >>> >>> >>> On Wed, Aug 28, 2013 at 9:36 AM, Raj Hadoop wrote: >>>> >>>> Hello all, >>>> >>>> I am getting an error while using sqoop export ( Load HDFS file to Oracle >>>> ). I am not sure the issue might be a Sqoop or Hadoop related one. So I am >>>> sending it to both the dist lists. >>>> >>>> I am using - >>>> >>>> sqoop export --connect jdbc:oracle:thin:@//dbserv:9876/OKI --table >>>> RAJ.CUSTOMERS --export-dir /user/hive/warehouse/web_cust --input-null-string >>>> '\\N' --input-null-non-string '\\N' --username <> --password <> -m 1 >>>> --input-fields-terminated-by '\t' >>>> I am getting the following error - >>>> >>>> Warning: /usr/lib/hbase does not exist! HBase imports will fail. >>>> Please set $HBASE_HOME to the root of your HBase installation. >>>> Warning: $HADOOP_HOME is deprecated. >>>> 13/08/28 09:42:36 WARN tool.BaseSqoopTool: Setting your password on the >>>> command-line is insecure. Consider using -P instead. >>>> 13/08/28 09:42:36 INFO manager.SqlManager: Using default fetchSize of 1000 >>>> 13/08/28 09:42:36 INFO tool.CodeGenTool: Beginning code generation >>>> 13/08/28 09:42:38 INFO manager.OracleManager: Time zone has been set to >>>> GMT >>>> 13/08/28 09:42:38 INFO manager.SqlManager: Executing SQL statement: SELECT >>>> t.* FROM RAJ.CUSTOMERS t WHERE 1=0 >>>> 13/08/28 09:42:38 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is >>>> /software/hadoop/hadoop/hadoop-1.1.2 >>>> Note: >>>> /tmp/sqoop-hadoop/compile/c1376f66d2151b48024c54305377c981/RAJ_CUSTOMERS.java >>>> uses or overrides a deprecated API. >>>> Note: Recompile with -Xlint:deprecation for details. >>>> 13/08/28 09:42:40 INFO orm.CompilationManager: Writing jar file: >>>> /tmp/sqoop-hadoop/compile/c1376f66d2151b48024c54305377c981/RAJ.CUSTOMERS.jar >>>> 13/08/28 09:42:40 INFO mapreduce.ExportJobBase: Beginning export of >>>> RAJ.CUSTOMERS >>>> 13/08/28 09:42:41 INFO manager.OracleManager: Time zone has been set to >>>> GMT >>>> 13/08/28 09:42:43 INFO input.FileInputFormat: Total input paths to process >>>> : 1 >>>> 13/08/28 09:42:43 INFO input.FileInputFormat: Total input paths to process >>>> : 1 >>>> 13/08/28 09:42:43 INFO util.NativeCodeLoader: Loaded the native-hadoop >>>> library >>>> 13/08/28 09:42:43 WARN snappy.LoadSnappy: Snappy native library not loaded >>>> 13/08/28 09:42:43 INFO mapred.JobClient: Running job: >>>> job_201307041900_0463 >>>> 13/08/28 09:42:44 INFO mapred.JobClient: map 0% reduce 0% >>>> 13/08/28 09:42:56 INFO mapred.JobClient: map 1% reduce 0% >>>> 13/08/28 09:43:00 INFO mapred.JobClient: map 2% reduce 0% >>>> 13/08/28 09:43:03 INFO mapred.JobClient: map 4% reduce 0% >>>> 13/08/28 09:43:10 INFO mapred.JobClient: map 5% reduce 0% >>>> 13/08/28 09:43:13 INFO mapred.JobClient: map 6% reduce 0% >>>> 13/08/28 09:43:17 INFO mapred.JobClient: Task Id : >>>> attempt_201307041900_0463_m_000000_0, Status : FAILED >>>> java.io.IOException: Can't export data, please check task tracker logs >>>> at >>>> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112) >>>> at >>>> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39) >>>> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) >>>> at >>>> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) >>>> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) >>>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) >>>> at org.apache.hadoop.mapred.Child$4.run(Child.java:255) >>>> at java.security.AccessController.doPrivileged(Native Method) >>>> at javax.security.auth.Subject.doAs(Subject.java:415) >>>> at >>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) >>>> at org.apache.hadoop.mapred.Child.main(Child.java:249) >>>> Caused by: java.util.NoSuchElementException >>>> at java.util.ArrayList$Itr.next(ArrayList.java:794) >>>> at RAJ_CUSTOMERS.__loadFromFields(RAJ_CUSTOMERS.java:1057) >>>> at RAJ_CUSTOMERS.parse(RAJ_CUSTOMERS.java:876) >>>> at >>>> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83) >>>> ... 10 more >>>> >>>> Thanks, >>>> Raj >>>> >>>> >>> >>> >