hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "QuickStart" by DavidBiesack
Date Fri, 11 Feb 2011 16:18:41 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "QuickStart" page has been changed by DavidBiesack.
The comment on this change is: fix example. show how to stop.
http://wiki.apache.org/hadoop/QuickStart?action=diff&rev1=24&rev2=25

--------------------------------------------------

  {{{
  mkdir input
  cp conf/*.xml input
- bin/hadoop jar build/hadoop-0.16.0-dev-examples.jar grep input output 'dfs[a-z.]+'
+ bin/hadoop jar hadoop-mapred-examples-0.21.0.jar grep input output 'security[a-z.]+'
  cat output/*
  }}}
  
@@ -60, +60 @@

  
  {{{
  cat output/*
+ 
+ 1	security.task.umbilical.protocol.acl
+ 1	security.refresh.policy.protocol.acl
+ 1	security.namenode.protocol.acl
+ 1	security.job.submission.protocol.acl
+ 1	security.inter.tracker.protocol.acl
+ 1	security.inter.datanode.protocol.acl
+ 1	security.datanode.protocol.acl
- 2       dfs.
- 1       dfs.block.size
- 1       dfs.blockreport.interval
- 1       dfs.client.block.write.retries
- 1       dfs.client.buffer.dir
- 1       dfs.data.dir
- 1       dfs.datanode.bind
- 1       dfs.datanode.dns.interface
- 1       dfs.datanode.dns.nameserver
- 1       dfs.datanode.du.pct
- 1       dfs.datanode.du.reserved
- 1       dfs.datanode.port
  ...(and so on)
  }}}
  
- If you saw the error `Exception in thread "main" java.lang.NoClassDefFoundError: build/hadoop-0/16/0-dev-examples/jar`
it means you forgot to type `jar` after `bin/hadoop` If you were unable to run this example,
roll back to a previous night's version. If it seemed to run fine but cat didn't spit anything
out you probably mistyped something. Try copying the command directly from the wiki to avoid
typos. You'll need to wipe out the output directory between each run.
+ If you saw the error `Exception in thread "main" java.lang.NoClassDefFoundError: hadoop-mapred-examples-0/21/0/jar`
it means you forgot to type `jar` after `bin/hadoop` If you were unable to run this example,
roll back to a previous night's version. If it seemed to run fine but cat didn't spit anything
out you probably mistyped something. Try copying the command directly from the wiki to avoid
typos. You'll need to wipe out the output directory between each run.
  
  Congratulations you have just successfully run your first MapReduce with Hadoop.
  
@@ -106, +102 @@

  
  Now check that the command 
  `ssh localhost`
- does not require a password. If it does, execute the following commands:
+ does not require a password. If it does, set up passwordless ssh. For example, you can execute
the following commands:
  {{{
  ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
  cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
@@ -114, +110 @@

  
  Now, try `ssh localhost` again. If this doesn't work you're doing to have to figure out
what's going on with your `ssh-agent` on your own.
  
- '''Window Users''' To start ssh server, you need run "ssh-host-config -y" in cygwin enviroment.
If he ask for CYGWIN environment value, set it to "ntsec tty". After you can run server from
cygwin "cygrunsrv --start sshd" or from Windows command line "net start sshd".
+ '''Window Users''' To start ssh server, you need run "ssh-host-config -y" in cygwin environment.
If he ask for CYGWIN environment value, set it to "ntsec tty". After you can run server from
cygwin "cygrunsrv --start sshd" or from Windows command line "net start sshd".
  
  '''Mac Users''' In recent versions of OSX, ssh-agent is already set up with launchd and
keychain. This can be verified by executing "echo $SSH_AUTH_SOCK" in your favorite shell.
You can use ssh-add -k and -K to add your keys and passphrases to your keychain.
  
@@ -136, +132 @@

  {{{bin/hadoop dfs -put <localsrc> <dst>}}}
  For more details just type `bin/hadoop dfs` with no options.
  
+ To shutdown:
+ 
+ {{{bin/stop-all.sh}}}
+ 
  == Stage 3: Fully-distributed operation ==
  
  Distributed operation is just like the pseudo-distributed operation described above, except:

Mime
View raw message