Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 38A6CC0FE for ; Fri, 14 Nov 2014 20:22:35 +0000 (UTC) Received: (qmail 42568 invoked by uid 500); 14 Nov 2014 20:22:29 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 42461 invoked by uid 500); 14 Nov 2014 20:22:29 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 42451 invoked by uid 99); 14 Nov 2014 20:22:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Nov 2014 20:22:28 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.217.172] (HELO mail-lb0-f172.google.com) (209.85.217.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Nov 2014 20:22:23 +0000 Received: by mail-lb0-f172.google.com with SMTP id u10so5962110lbd.17 for ; Fri, 14 Nov 2014 12:22:02 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:date:message-id:subject:from :to:content-type; bh=S0R2CDmxwuFyAkpae+Do5fFVqaNecNjr60jU1n8F25g=; b=GjXxrqploomcjXha7BSuvf/xE5+SIr/tXdUGb2wRkNOETYcZpEzXyy6W3d9A4hO88v CHvdLWZOVxLb4rXrcJYyfKIIS05VSjZj8tOYPj5SPQsvSg1YbVv2GRL8tVJZTXyfRF4w e23OjhXZkQvWq5+2/q0Y4LdPxMrJNQd6TTEjxkDKMYurvFTgn7ctZqWG/hUvERaMQBC9 xZOFmyPVei4l5NenknjYKS1AQlE5FNxaf/V21f+qxF/5dQ3KGv9iFXhi5TNrBwG0t5Pw 2V+XYV7HLOPhqpst8GvtXd4xWOo/b0U8p5aqpnmP6iGHzoVkUxB9QNzReUa184Ck34zK 1/Dg== X-Gm-Message-State: ALoCoQlz59S3/A3NqfFcjvLPz5HHkA4/ppiuG3CucXqVFYF3Gx5VarnA0Rkb9+6+jH1p+e0IPb8R MIME-Version: 1.0 X-Received: by 10.152.5.100 with SMTP id r4mr10272801lar.26.1415996522202; Fri, 14 Nov 2014 12:22:02 -0800 (PST) Sender: tixu@eng.ucsd.edu Received: by 10.114.245.225 with HTTP; Fri, 14 Nov 2014 12:22:02 -0800 (PST) Date: Fri, 14 Nov 2014 12:22:02 -0800 X-Google-Sender-Auth: BNMerOLQCR8f6tEMp9fyLwu9c9k Message-ID: Subject: Are these configuration parameters deprecated? From: Tianyin Xu To: user@hadoop.apache.org Content-Type: text/plain; charset=UTF-8 X-Virus-Checked: Checked by ClamAV on apache.org Hi, I'm very confused by some of the MapReduce configuration parameters which appear in the latest version of mapred-default.xml. http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml Take "mapreduce.task.tmp.dir" as an example, I fail to find its usage in code but /* mapreduce/util/ConfigUtil.java */ 55 new DeprecationDelta("mapred.temp.dir", 56 MRConfig.TEMP_DIR), My interpretation is that it's renamed into "mapred.temp.dir". However, when I grep the new name, I still cannot find any code except some testing ones in ./hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/BenchmarkThroughput.java >From the semantics, this should be a "must-to-have" parameter for MR jobs... Also, many parameters are like this. So I'm really confused. Am I missing something? Are these parameters deprecated? Thanks a lot! Tianyin