hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ballard, David H" <Dball...@NSHS.edu>
Subject hadoop - scoop test data load
Date Fri, 04 Oct 2013 18:43:47 GMT
I am testing scoop to load data from mysql.  I am following the example in the hadoop book.
I am running the code in pseudo-distributed mode on Centos.

In the cluster/schedule, the ID is listed with state = ACCEPTED, finalstatus=UNDEFINED, tracking
UI = UNASSIGNED.

If I browse the HDFS file system, I do not see the file.  I also looked at the hadoop-hdfs-datanode/namenode
logs but I don't see an error.

Below is the output from running the command.  It looks like it is hung up - it stops at 'running
the job'

Any suggestions on how I can trouble shoot this?
Thank you,
David


[hadoop@localhost javaFiles]$ /usr/bin/sqoop import --connect jdbc:mysql://localhost/test
--table variant -m 1
13/10/04 12:51:11 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/10/04 12:51:11 INFO tool.CodeGenTool: Beginning code generation
13/10/04 12:51:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `variant`
AS t LIMIT 1
13/10/04 12:51:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `variant`
AS t LIMIT 1
13/10/04 12:51:12 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop
Note: /tmp/sqoop-hadoop/compile/d5af2fc350428ba0e6d2396bee566452/variant.java uses or overrides
a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
13/10/04 12:51:19 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/d5af2fc350428ba0e6d2396bee566452/variant.jar
13/10/04 12:51:19 WARN manager.MySQLManager: It looks like you are importing from mysql.
13/10/04 12:51:19 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
13/10/04 12:51:19 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
13/10/04 12:51:19 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull
(mysql)
13/10/04 12:51:19 INFO mapreduce.ImportJobBase: Beginning import of variant
13/10/04 12:51:19 WARN conf.Configuration: mapred.job.tracker is deprecated. Instead, use
mapreduce.jobtracker.address
13/10/04 12:51:20 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
13/10/04 12:51:21 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
13/10/04 12:51:22 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl
is inited.
13/10/04 12:51:22 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl
is started.
13/10/04 12:51:24 INFO mapreduce.JobSubmitter: number of splits:1
13/10/04 12:51:24 WARN conf.Configuration: mapred.job.classpath.files is deprecated. Instead,
use mapreduce.job.classpath.files
13/10/04 12:51:24 WARN conf.Configuration: mapred.cache.files is deprecated. Instead, use
mapreduce.job.cache.files
13/10/04 12:51:24 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use
mapreduce.job.reduces
13/10/04 12:51:24 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead,
use mapreduce.job.output.value.class
13/10/04 12:51:24 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use
mapreduce.job.map.class
13/10/04 12:51:24 WARN conf.Configuration: mapred.job.name<http://mapred.job.name> is
deprecated. Instead, use mapreduce.job.name<http://mapreduce.job.name>
13/10/04 12:51:24 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead,
use mapreduce.job.inputformat.class
13/10/04 12:51:24 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
13/10/04 12:51:24 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead,
use mapreduce.job.outputformat.class
13/10/04 12:51:24 WARN conf.Configuration: mapred.cache.files.timestamps is deprecated. Instead,
use mapreduce.job.cache.files.timestamps
13/10/04 12:51:24 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead,
use mapreduce.job.output.key.class
13/10/04 12:51:24 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use
mapreduce.job.working.dir
13/10/04 12:51:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1380724403185_0002
13/10/04 12:51:26 INFO client.YarnClientImpl: Submitted application application_1380724403185_0002
to ResourceManager at /0.0.0.0:8032<http://0.0.0.0:8032>
13/10/04 12:51:26 INFO mapreduce.Job: The url to track the job: http://localhost.localdomain:8088/proxy/application_1380724403185_0002/
13/10/04 12:51:26 INFO mapreduce.Job: Running job: job_1380724403185_0002


The information contained in this electronic e-mail transmission and any attachments are intended
only for the use of the individual or entity to whom or to which it is addressed, and may
contain information that is privileged, confidential and exempt from disclosure under applicable
law. If the reader of this communication is not the intended recipient, or the employee or
agent responsible for delivering this communication to the intended recipient, you are hereby
notified that any dissemination, distribution, copying or disclosure of this communication
and any attachment is strictly prohibited. If you have received this transmission in error,
please notify the sender immediately by telephone and electronic mail, and delete the original
communication and any attachment from any computer, server or other electronic recording or
storage device or medium. Receipt by anyone other than the intended recipient is not a waiver
of any attorney-client, physician-patient or other privilege.
Mime
View raw message