Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 48AF5ED39 for ; Wed, 30 Jan 2013 13:47:28 +0000 (UTC) Received: (qmail 32073 invoked by uid 500); 30 Jan 2013 13:47:23 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 31962 invoked by uid 500); 30 Jan 2013 13:47:23 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 31946 invoked by uid 99); 30 Jan 2013 13:47:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 13:47:22 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of donofrio111@gmail.com designates 209.85.216.178 as permitted sender) Received: from [209.85.216.178] (HELO mail-qc0-f178.google.com) (209.85.216.178) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2013 13:47:15 +0000 Received: by mail-qc0-f178.google.com with SMTP id j34so722258qco.23 for ; Wed, 30 Jan 2013 05:46:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=4DlhtUr0YzWHWqgO3MRQDPJXLWOSqMV+p20uyid0dAs=; b=tAceJoawFlFkQud/1bT7R0SXEbNEJAyhXUADRddb6geuI0QrFk/wGqvym5nX/BAgwN 2M56lHTvYyxzjYMWuZmeweI5KwEBwdbGZSpfBn7Vjz/1INuzE4G8Pjkx0jyeVNEr99+f hL1Qx0gdq2nM0/D/PxHGU5MGO6xr5AzR6xmjlkWp0dSa0q/cKFxFQ1lbqvpv7mpUevFK nYdqVfF8vixjbohmhv+5xna8iNIfQ0xTtLnuGJwxObYxfYI0zJp1lz4P+sf8Ez3TE4xP 5/9kapMiUHF85RZzYrfB077kQwyD97Ta5swSHVYH8Q64YmIFZJFvdWFJRrcxhbizhb0C khtQ== X-Received: by 10.224.106.193 with SMTP id y1mr4933527qao.42.1359553613883; Wed, 30 Jan 2013 05:46:53 -0800 (PST) Received: from [192.168.0.2] (c-68-55-55-92.hsd1.md.comcast.net. [68.55.55.92]) by mx.google.com with ESMTPS id z17sm1052629qem.4.2013.01.30.05.46.52 (version=TLSv1 cipher=RC4-SHA bits=128/128); Wed, 30 Jan 2013 05:46:53 -0800 (PST) Message-ID: <5109244C.4010107@gmail.com> Date: Wed, 30 Jan 2013 08:46:52 -0500 From: Jim Donofrio User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130110 Thunderbird/17.0.2 MIME-Version: 1.0 To: user@hadoop.apache.org Subject: negative map input bytes counter? Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org I have seen the map input bytes counter go negative temporarily on hadoop 1.x at the beginning of a job. It then corrects itself later in the job and seems to be accurate. Any ideas? http://terrier.org/docs/v2.2.1/hadoop_indexing.html I also saw this behavior in a job output listed at the above site: INFO JobClient - Map output bytes=7724117 INFO JobClient - Map input bytes=-4167449 INFO JobClient - Combine input records=0