From hadoop-dev-return-5913-apmail-lucene-hadoop-dev-archive=lucene.apache.org@lucene.apache.org Tue Dec 12 20:32:54 2006 Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 51071 invoked from network); 12 Dec 2006 20:32:53 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 12 Dec 2006 20:32:53 -0000 Received: (qmail 66507 invoked by uid 500); 12 Dec 2006 20:33:00 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 66485 invoked by uid 500); 12 Dec 2006 20:33:00 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 66470 invoked by uid 99); 12 Dec 2006 20:33:00 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Dec 2006 12:33:00 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Dec 2006 12:32:51 -0800 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 27B6A7141A3 for ; Tue, 12 Dec 2006 12:32:31 -0800 (PST) Message-ID: <2589220.1165955551160.JavaMail.jira@brutus> Date: Tue, 12 Dec 2006 12:32:31 -0800 (PST) From: "Doug Cutting (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-571) Path should use URI syntax In-Reply-To: <6678550.1159825879600.JavaMail.root@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ http://issues.apache.org/jira/browse/HADOOP-571?page=all ] Doug Cutting updated HADOOP-571: -------------------------------- Status: Patch Available (was: In Progress) Unless there are objections, I'll commit this soon. > Path should use URI syntax > -------------------------- > > Key: HADOOP-571 > URL: http://issues.apache.org/jira/browse/HADOOP-571 > Project: Hadoop > Issue Type: Improvement > Components: fs > Reporter: Doug Cutting > Assigned To: Doug Cutting > Fix For: 0.10.0 > > Attachments: uri.patch, uri2.patch, uri3.patch, uri4.patch, uri5.patch > > > The following changes are proposed: > 1. Add a factory/registry of FileSystem implementations. Given a protocol, hostname and port, it should be possible to get a FileSystem implementation. > 2. Path's constructor should accept URI-formatted strings & a configuration. > 3. A new Path method should be added: FileSystem.getFileSystem(). This returns the filesystem named in the path or the default configured filesystem. > 4. Most methods which currently take FileSystem and Path parameters can be changed to take only Path. > 5. Many FileSystem operations (create, open, delete, list, etc.) can become convenience methods on Path. > 6. A URLStreamHandler can be defined in terms of the FileSystem API, so that URLs for any protocol with a registered FileSystem implementation can be accessed with a java.net.URL, permitting FileSystem implementations to be used on the classpath, etc. > It is tempting to try to replace Path with java.net.URL, but URL's methods are insufficient for mapreduce. We require directory listings, random access, location hints, etc., which are not supported by existing URLStreamHandler implementations. But we can expose all FileSystem implementations for access with java.net.URL. > (From a brainstorm with Owen.) -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira