From hdfs-issues-return-24023-apmail-hadoop-hdfs-issues-archive=hadoop.apache.org@hadoop.apache.org Mon Aug 22 22:46:55 2011 Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 829628106 for ; Mon, 22 Aug 2011 22:46:54 +0000 (UTC) Received: (qmail 10750 invoked by uid 500); 22 Aug 2011 22:46:54 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 10669 invoked by uid 500); 22 Aug 2011 22:46:54 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 10659 invoked by uid 99); 22 Aug 2011 22:46:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 22:46:53 +0000 X-ASF-Spam-Status: No, hits=-2000.9 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 22:46:50 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id BB750CA99A for ; Mon, 22 Aug 2011 22:46:29 +0000 (UTC) Date: Mon, 22 Aug 2011 22:46:29 +0000 (UTC) From: "Alejandro Abdelnur (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <106950382.3307.1314053189764.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <208483421.9470.1311196562996.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-2178) Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089106#comment-13089106 ] Alejandro Abdelnur commented on HDFS-2178: ------------------------------------------ @Doug, I'm OK with giving up the cool names for Alfredo & Hoop (bummer). * Alfredo is pseudo, SPNEGO, plus pluggable, 'hadoop-spnego' would be a bit misleading, may be 'hadoop-auth' and eventually bubble up there all auth2 stuff. * Hoop could be either 'hadop-hdfs-rest' or 'hadoop-hdfs-http' Please comment on HADOOP-7560 regarding sub-module naming/organization. @Nicholas, Not sure I follow up your break up suggestion. Are you referring to MAPREDUCE-2863, to HFTP, or else? > Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities > ---------------------------------------------------------------------------------- > > Key: HDFS-2178 > URL: https://issues.apache.org/jira/browse/HDFS-2178 > Project: Hadoop HDFS > Issue Type: Improvement > Affects Versions: 0.23.0 > Reporter: Alejandro Abdelnur > Assignee: Alejandro Abdelnur > Fix For: 0.23.0 > > > We'd like to contribute Hoop to Hadoop HDFS as a replacement (an improvement) for HDFS Proxy. > Hoop provides access to all Hadoop Distributed File System (HDFS) operations (read and write) over HTTP/S. > The Hoop server component is a REST HTTP gateway to HDFS supporting all file system operations. It can be accessed using standard HTTP tools (i.e. curl and wget), HTTP libraries from different programing languages (i.e. Perl, Java Script) as well as using the Hoop client. The Hoop server component is a standard Java web-application and it has been implemented using Jersey (JAX-RS). > The Hoop client component is an implementation of Hadoop FileSystem client that allows using the familiar Hadoop filesystem API to access HDFS data through a Hoop server. > Repo: https://github.com/cloudera/hoop > Docs: http://cloudera.github.com/hoop > Blog: http://www.cloudera.com/blog/2011/07/hoop-hadoop-hdfs-over-http/ > Hoop is a Maven based project that depends on Hadoop HDFS and Alfredo (for Kerberos HTTP SPNEGO authentication). > To make the integration easy, HDFS Mavenization (HDFS-2096) would have to be done first, as well as the Alfredo contribution (HADOOP-7119). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira