Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B3CB37AB4 for ; Tue, 29 Nov 2011 14:53:39 +0000 (UTC) Received: (qmail 17579 invoked by uid 500); 29 Nov 2011 14:53:38 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 17515 invoked by uid 500); 29 Nov 2011 14:53:38 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 17485 invoked by uid 99); 29 Nov 2011 14:53:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2011 14:53:38 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lsingh.969@gmail.com designates 209.85.214.48 as permitted sender) Received: from [209.85.214.48] (HELO mail-bw0-f48.google.com) (209.85.214.48) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2011 14:53:32 +0000 Received: by bkbc12 with SMTP id c12so12377887bkb.35 for ; Tue, 29 Nov 2011 06:53:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=9zYz5lUz5Tozklm3fqmvMC/IhrffCozh0cy5o9Lsm+I=; b=pJ4z70XBB3W0j+maq8gJJHCKhyMyGEDK761oAoy4beKHoYd9Fq2CyHq3ERa31jIhBq oryZEWexZWBzM3WbiyNRw+zUwhtBHvHiHhQnVS5lx+9ZJ8BKpz18G8bqwTvRQ0/Sgkj6 h7FK7kyBRb0qhEK5pd8n63sD2/GpDmNGognUk= MIME-Version: 1.0 Received: by 10.205.127.139 with SMTP id ha11mr51632899bkc.111.1322578390787; Tue, 29 Nov 2011 06:53:10 -0800 (PST) Received: by 10.204.48.130 with HTTP; Tue, 29 Nov 2011 06:53:10 -0800 (PST) In-Reply-To: References: Date: Tue, 29 Nov 2011 09:53:10 -0500 Message-ID: Subject: Re: Mapping from JobSplit to Blocks on datanodes From: Lokendra Singh To: hdfs-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=000e0ce03ada2ba5b104b2e0c7e7 --000e0ce03ada2ba5b104b2e0c7e7 Content-Type: text/plain; charset=ISO-8859-1 Any pointers please ? I could see from the source says that it is not trivial to do. Was just wanted to confirm if there are some API calls I might have missed. Regards Lokendra On Mon, Nov 28, 2011 at 2:17 AM, Lokendra Singh wrote: > Hi, > > How can I find which Job Split does a Block on a datanode belong to? Or > going the other way, if I can find how a Job Split is eventually stored on > datanodes i.e. the list of Blocks. > Any pointers are appreciated. > > PS: My eventual objective is 'moving data to computation' (for some > experiments) and hence was taking ideas from Balancer class to move blocks. > > Regards > Lokendra > --000e0ce03ada2ba5b104b2e0c7e7--