Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C0E4810484 for ; Mon, 4 Nov 2013 09:29:11 +0000 (UTC) Received: (qmail 53843 invoked by uid 500); 4 Nov 2013 09:29:03 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 53764 invoked by uid 500); 4 Nov 2013 09:29:03 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 53753 invoked by uid 99); 4 Nov 2013 09:29:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 09:29:03 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jiangbinglover@gmail.com designates 209.85.219.50 as permitted sender) Received: from [209.85.219.50] (HELO mail-oa0-f50.google.com) (209.85.219.50) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Nov 2013 09:28:59 +0000 Received: by mail-oa0-f50.google.com with SMTP id j6so6810994oag.23 for ; Mon, 04 Nov 2013 01:28:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=NQ/d1uzokk6M8phWRbOn8PHs7c5TAiGcg0DE6eBkml8=; b=lKerFFLp9eAMkAar1yVcICMVnjM7BAAni8RoK8Xl8+eDcXZy7YCdbCVMF2700yMWX8 4L4H7v9W++SNUr40Vq5PBZq+g4e09GZmWBFV5diLDqm6RG0ifWo/Lw5gXTbN1wT6VJLb zLvUAt/0XLBZiFG4I98dZn2+LbNOnNF3QvsM34HIBwANRL42kfVhIgJHIaSWReDVCDzB ArHhHy/WkvKerOiiH2C98UKQKuvWKOok2ugODvByYnVahNe63G/JxZPNqsjp20nX0rz8 Bs20Fr3uQO7Bup9nKOMDwlN0v3Ik9Gg9dXsqC0mVJDvIXCZZ7BvWRPtIxJCxvHGab1gY wfMA== MIME-Version: 1.0 X-Received: by 10.182.22.18 with SMTP id z18mr3371154obe.42.1383557318473; Mon, 04 Nov 2013 01:28:38 -0800 (PST) Received: by 10.76.27.41 with HTTP; Mon, 4 Nov 2013 01:28:38 -0800 (PST) In-Reply-To: References: Date: Mon, 4 Nov 2013 17:28:38 +0800 Message-ID: Subject: Re: trace class calls in hadoop hdfs From: Bing Jiang To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11332d167e7da104ea568ad8 X-Virus-Checked: Checked by ClamAV on apache.org --001a11332d167e7da104ea568ad8 Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: quoted-printable I think you can try to use jdb, which exists in $JAVA_HOME/bin. Regards Bing 2013/11/4 Karim Awara > Hi, > > I want to trace the calls that both the DataNode and the NameNode do when > I execute a shell command on the hdfs such as (hadoop dfs -put {src} > {dst}). Any idea how to do that? > > > ; tracing including the data node asking the name node for the blockID.. > also the class where datanode use to determine the replica datanodes in t= he > pipe ..etc > > -- > Best Regards, > Karim Ahmed Awara > > ------------------------------ > This message and its contents, including attachments are intended solely > for the original recipient. If you are not the intended recipient or have > received this message in error, please notify me immediately and delete > this message from your computer system. Any unauthorized use or > distribution is prohibited. Please consider the environment before printi= ng > this email. --=20 Bing Jiang Tel=A3=BA(86)134-2619-1361 weibo: http://weibo.com/jiangbinglover BLOG: www.binospace.com BLOG: http://blog.sina.com.cn/jiangbinglover Focus on distributed computing, HDFS/HBase --001a11332d167e7da104ea568ad8 Content-Type: text/html; charset=GB2312 Content-Transfer-Encoding: quoted-printable
I think you can try to use jdb, which exists in = $JAVA_HOME/bin.

Regards
Bing


2013/11/4 Karim Awara <karim.awara@kaust.edu.sa>
Hi,

= I want to trace the calls that both the DataNode and the NameNode do when I= execute a shell command on the hdfs such as (hadoop dfs -put {src} {dst}).= Any idea how to do that?


; tracing including the data node asking the name node for th= e blockID.. also the class where datanode use to determine the replica data= nodes in the pipe ..etc

--
Best Regards,
Karim Ahmed Awara


This message and its content= s, including attachments are intended solely for the original recipient. If= you are not the intended recipient or have received this message in error,= please notify me immediately and delete this message from your computer sy= stem. Any unauthorized use or distribution is prohibited. Please consider t= he environment before printing this email.



--
Bing Jiang
Tel= =A3=BA(86)134-2619-1361
weibo: http://weibo.com/jiangbinglover
BLOG: www.binospace.com
BLOG: = http://blog.sina.com.cn/jiangbinglover 
Focus on distributed c= omputing, HDFS/HBase
--001a11332d167e7da104ea568ad8--