Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB17710A20 for ; Thu, 29 Aug 2013 04:42:22 +0000 (UTC) Received: (qmail 81692 invoked by uid 500); 29 Aug 2013 04:42:17 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 81590 invoked by uid 500); 29 Aug 2013 04:42:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 81581 invoked by uid 99); 29 Aug 2013 04:42:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Aug 2013 04:42:16 +0000 X-ASF-Spam-Status: No, hits=1.0 required=5.0 tests=FORGED_YAHOO_RCVD,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [98.138.90.90] (HELO nm27.bullet.mail.ne1.yahoo.com) (98.138.90.90) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Aug 2013 04:42:11 +0000 Received: from [98.138.90.49] by nm27.bullet.mail.ne1.yahoo.com with NNFMP; 29 Aug 2013 04:41:50 -0000 Received: from [98.138.226.124] by tm2.bullet.mail.ne1.yahoo.com with NNFMP; 29 Aug 2013 04:41:50 -0000 Received: from [127.0.0.1] by smtp203.mail.ne1.yahoo.com with NNFMP; 29 Aug 2013 04:41:50 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1377751310; bh=3staIWv1MjdA2IPIB+7TvBhL6qUcrA+7HEflZOn/pXA=; h=X-Yahoo-Newman-Id:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:X-Rocket-Received:Content-Type:Mime-Version:Subject:From:In-Reply-To:Date:Content-Transfer-Encoding:Message-Id:References:To:X-Mailer; b=kEa9qgkzJQOFKtDfW5NdLtdJHrpqW28l5pT9QXgEq1QleS/R1C9a9CGRnjzMAoYW+ykwbbH8ni9qWcE/HddOyEpRvregregZNxNvy6MxZtLuo/WpOV/hPfX0ueIm8NbS2rP8mcBv/sTifp/kCePkxAVrqKkbJuYvspI+jQCFu7c= X-Yahoo-Newman-Id: 608125.14509.bm@smtp203.mail.ne1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: G3PO4tkVM1lTLdCJzsBd8rjskbMIdGmLmvG_ZS6ystAKRFw YU3Rd6N5hAJCacDAA3FvFyC052YBxqk2HAAu8gNJ3fR5s81RqvVklG8ONmP9 irvHiaDFb38rz2sWmmeQQ.zXQMiYvTN0SCym0cO0KZ2v3.YGlCdN_bxcL023 oHEu7W.HLxIuzT53XWb7eRMXFvVrGpOBn51jYPE5P8tFWQt6.q_GJt7SNr7f c99tRr7Gg_ZXK03HnvYp2ujXorymnmaIKqGiOqIOEzXlzdg.Qp1UfXBCPIIz .JcH75LrSvgu8XePv8vlmdMNFdhQ2z.7GaZ10Jojs1tIRseYNkL8aG39Udgw egySkYIOkDnOdfQFCLS33aKqGsr1Erg_RbqAOTIX4qOut0KsSoIcd9ZPNZVD 8.NRPFCUuH6B4Nfgkr9ZV8bw5c4lagG3JsmJsQIWOLAG3Y4u.iQXAL3ith8E iPyNb6hPBsB8Ni4vRtIqTLSJhBHyuc6M8AmMhNra3luNve7iWlwIW X-Yahoo-SMTP: wAmACb2swBAbGB5tIMGjPhB3C7qzJA-- X-Rocket-Received: from [192.168.2.2] (hadoopraj@71.196.53.15 with ) by smtp203.mail.ne1.yahoo.com with SMTP; 28 Aug 2013 21:41:50 -0700 PDT Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: Sqoop issue related to Hadoop From: Hadoop Raj In-Reply-To: Date: Thu, 29 Aug 2013 00:43:59 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1377707767.87327.YahooMailNeo@web162203.mail.bf1.yahoo.com> To: user@hadoop.apache.org X-Mailer: Apple Mail (2.1508) X-Virus-Checked: Checked by ClamAV on apache.org Hi Kate, Where can I find the task attempt log? Can you specify the location = please? Thanks, Raj On Aug 28, 2013, at 7:13 PM, Kathleen Ting wrote: > Raj, in addition to what Abe said, please also send the failed task = attempt log > attempt_201307041900_0463_m_000000_0 as well. >=20 > Thanks, > Kate >=20 > On Wed, Aug 28, 2013 at 2:25 PM, Abraham Elmahrek = wrote: >> Hey Raj, >>=20 >> It seems like the number of fields you have in your data doesn't = match the >> number of fields in your RAJ.CUSTOMERS table. >>=20 >> Could you please add "--verbose" to the beginning of your argument = list and >> provide the entire contents here? >>=20 >> -Abe >>=20 >>=20 >> On Wed, Aug 28, 2013 at 9:36 AM, Raj Hadoop = wrote: >>>=20 >>> Hello all, >>>=20 >>> I am getting an error while using sqoop export ( Load HDFS file to = Oracle >>> ). I am not sure the issue might be a Sqoop or Hadoop related one. = So I am >>> sending it to both the dist lists. >>>=20 >>> I am using - >>>=20 >>> sqoop export --connect jdbc:oracle:thin:@//dbserv:9876/OKI --table >>> RAJ.CUSTOMERS --export-dir /user/hive/warehouse/web_cust = --input-null-string >>> '\\N' --input-null-non-string '\\N' --username <> --password <> -m = 1 >>> --input-fields-terminated-by '\t' >>> I am getting the following error - >>>=20 >>> Warning: /usr/lib/hbase does not exist! HBase imports will fail. >>> Please set $HBASE_HOME to the root of your HBase installation. >>> Warning: $HADOOP_HOME is deprecated. >>> 13/08/28 09:42:36 WARN tool.BaseSqoopTool: Setting your password on = the >>> command-line is insecure. Consider using -P instead. >>> 13/08/28 09:42:36 INFO manager.SqlManager: Using default fetchSize = of 1000 >>> 13/08/28 09:42:36 INFO tool.CodeGenTool: Beginning code generation >>> 13/08/28 09:42:38 INFO manager.OracleManager: Time zone has been set = to >>> GMT >>> 13/08/28 09:42:38 INFO manager.SqlManager: Executing SQL statement: = SELECT >>> t.* FROM RAJ.CUSTOMERS t WHERE 1=3D0 >>> 13/08/28 09:42:38 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is >>> /software/hadoop/hadoop/hadoop-1.1.2 >>> Note: >>> = /tmp/sqoop-hadoop/compile/c1376f66d2151b48024c54305377c981/RAJ_CUSTOMERS.j= ava >>> uses or overrides a deprecated API. >>> Note: Recompile with -Xlint:deprecation for details. >>> 13/08/28 09:42:40 INFO orm.CompilationManager: Writing jar file: >>> = /tmp/sqoop-hadoop/compile/c1376f66d2151b48024c54305377c981/RAJ.CUSTOMERS.j= ar >>> 13/08/28 09:42:40 INFO mapreduce.ExportJobBase: Beginning export of >>> RAJ.CUSTOMERS >>> 13/08/28 09:42:41 INFO manager.OracleManager: Time zone has been set = to >>> GMT >>> 13/08/28 09:42:43 INFO input.FileInputFormat: Total input paths to = process >>> : 1 >>> 13/08/28 09:42:43 INFO input.FileInputFormat: Total input paths to = process >>> : 1 >>> 13/08/28 09:42:43 INFO util.NativeCodeLoader: Loaded the = native-hadoop >>> library >>> 13/08/28 09:42:43 WARN snappy.LoadSnappy: Snappy native library not = loaded >>> 13/08/28 09:42:43 INFO mapred.JobClient: Running job: >>> job_201307041900_0463 >>> 13/08/28 09:42:44 INFO mapred.JobClient: map 0% reduce 0% >>> 13/08/28 09:42:56 INFO mapred.JobClient: map 1% reduce 0% >>> 13/08/28 09:43:00 INFO mapred.JobClient: map 2% reduce 0% >>> 13/08/28 09:43:03 INFO mapred.JobClient: map 4% reduce 0% >>> 13/08/28 09:43:10 INFO mapred.JobClient: map 5% reduce 0% >>> 13/08/28 09:43:13 INFO mapred.JobClient: map 6% reduce 0% >>> 13/08/28 09:43:17 INFO mapred.JobClient: Task Id : >>> attempt_201307041900_0463_m_000000_0, Status : FAILED >>> java.io.IOException: Can't export data, please check task tracker = logs >>> at >>> = org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)= >>> at >>> = org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39) >>> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) >>> at >>> = org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:= 64) >>> at = org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) >>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) >>> at org.apache.hadoop.mapred.Child$4.run(Child.java:255) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at javax.security.auth.Subject.doAs(Subject.java:415) >>> at >>> = org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.= java:1149) >>> at org.apache.hadoop.mapred.Child.main(Child.java:249) >>> Caused by: java.util.NoSuchElementException >>> at java.util.ArrayList$Itr.next(ArrayList.java:794) >>> at RAJ_CUSTOMERS.__loadFromFields(RAJ_CUSTOMERS.java:1057) >>> at RAJ_CUSTOMERS.parse(RAJ_CUSTOMERS.java:876) >>> at >>> = org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83) >>> ... 10 more >>>=20 >>> Thanks, >>> Raj >>>=20 >>>=20 >>=20 >>=20