Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 66028 invoked from network); 12 Apr 2010 09:14:04 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 12 Apr 2010 09:14:04 -0000 Received: (qmail 42189 invoked by uid 500); 12 Apr 2010 09:14:04 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 42027 invoked by uid 500); 12 Apr 2010 09:14:04 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 42009 invoked by uid 99); 12 Apr 2010 09:14:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Apr 2010 09:14:03 +0000 X-ASF-Spam-Status: No, hits=-1265.5 required=10.0 tests=ALL_TRUSTED,AWL X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Apr 2010 09:14:02 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o3C9DgNm023979 for ; Mon, 12 Apr 2010 05:13:42 -0400 (EDT) Message-ID: <5498561.19481271063622143.JavaMail.jira@thor> Date: Mon, 12 Apr 2010 05:13:42 -0400 (EDT) From: "Iyappan Srinivasan (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Updated: (MAPREDUCE-1676) Create test scenario for "distributed cache file behaviour, when dfs file is modified" In-Reply-To: <904417634.14801270566274067.JavaMail.jira@brutus.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1676: ------------------------------------------ Attachment: TestDistributedCacheModifiedFile.patch TEST-org.apache.hadoop.mapred.TestDistributedCacheModifiedFile.txt Thanks Cos for your comments. Uploaded new patch incorporating Cos comments and some minor nits. Attached test results also. > Create test scenario for "distributed cache file behaviour, when dfs file is modified" > -------------------------------------------------------------------------------------- > > Key: MAPREDUCE-1676 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1676 > Project: Hadoop Map/Reduce > Issue Type: Test > Affects Versions: 0.22.0 > Reporter: Iyappan Srinivasan > Assignee: Iyappan Srinivasan > Attachments: TEST-org.apache.hadoop.mapred.TestDistributedCacheModifiedFile.txt, TestDistributedCacheModifiedFile.patch, TestDistributedCacheModifiedFile.patch > > > Verify the Distributed Cache functionality. This test scenario is for a distributed cache file behaviour when it is modified before and after being accessed by maximum two jobs. Once a job uses a distributed cache file that file is stored in the mapred.local.dir. If the next job > uses the same file, but with differnt timestamp, then that file is stored again. So, if two jobs choose the same tasktracker for their job execution then, the distributed cache file should be found twice. > This testcase runs a job with a distributed cache file. All the tasks' corresponding tasktracker's handle is got and checked for the presence of distributed cache with proper permissions in the proper directory. Next when job runs again and if any of its tasks hits the same tasktracker, which ran one of the task of the previous job, then that > file should be uploaded again and task should not use the old file. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira