Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 34990 invoked from network); 26 Jun 2008 22:35:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Jun 2008 22:35:29 -0000 Received: (qmail 88822 invoked by uid 500); 26 Jun 2008 22:35:29 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 88791 invoked by uid 500); 26 Jun 2008 22:35:29 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 88780 invoked by uid 99); 26 Jun 2008 22:35:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jun 2008 15:35:29 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lincoln.ritter@gmail.com designates 209.85.200.173 as permitted sender) Received: from [209.85.200.173] (HELO wf-out-1314.google.com) (209.85.200.173) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jun 2008 22:34:36 +0000 Received: by wf-out-1314.google.com with SMTP id 24so211158wfg.2 for ; Thu, 26 Jun 2008 15:34:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender :to:subject:mime-version:content-type:content-transfer-encoding :content-disposition:x-google-sender-auth; bh=TzpdI2eOtF5VwHSBcyFmaKLOkLyoyssTY7PSJfIWrGw=; b=WluOJRFW4GBYlEZ68mWvsLY2PkvF/eQzEuxMhkO33yE4fQXA93ZENULjAflmFQk5kw 1w3qc7u/BPZqbyU0/ihBniAAeOEyB7WNtRp7YAHS8t0BRFAvbnPvmaWH6nlJnjGjqPCw H2rTYdoc1n8/Im+DH0bHMq6VDwgBxaNvJNRUw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition:x-google-sender-auth; b=Kci9aQ5qqDaDjiIRGOHb44kZzhumCby725l0gbUC7WP8oxI5jurUPpamqRfldHn8XL rVw2jEtMe3DcVIa2dZ8Dzkof1P6stAY+cNEcw3H6hirCEHpj5WmqMFaprO9MJmsFBr5o Y3/MyBVUR8rJgaa3gSvct5ZJ6jSK+e9Y6vSu0= Received: by 10.142.188.3 with SMTP id l3mr172858wff.174.1214519696003; Thu, 26 Jun 2008 15:34:56 -0700 (PDT) Received: by 10.142.218.21 with HTTP; Thu, 26 Jun 2008 15:34:55 -0700 (PDT) Message-ID: <5dd5b7e40806261534v1adcdb61l2aaa86d784f4df4@mail.gmail.com> Date: Thu, 26 Jun 2008 15:34:55 -0700 From: "Lincoln Ritter" Sender: lincoln.ritter@gmail.com To: core-dev Subject: Determining "Hidden" Files in Hadoop MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Google-Sender-Auth: 8e9ade1e99f34755 X-Virus-Checked: Checked by ClamAV on apache.org Greetings, Over on the Nutch dev list there's been a bit of chatter about files/folders generated by Hadoop (generally speaking 0.17) such as '_logs'. Digging through Hadoop a bit revealed that there is a private hiddenFileFilter in FileInputFilter.java. This is similar to what I came up with here: http://www.mail-archive.com/nutch-dev@lucene.apache.org/msg08214.html I couldn't find any other mention of "hidden" files in the Hadoop codebase or the wiki and little on the mailing lists. Is there a defined standard for hidden files or a public interface for determining file visibility? Thanks! -lincoln -- lincolnritter.com