Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of dachuy@gmail.com designates
 209.85.222.177 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:cc:subject
         :references:in-reply-to:content-type:content-transfer-encoding;
        b=LUaGmBRGOLNtJiBHAPo8+Y4uNg5+SzwRfU4/HfQfcpvkvfCq4h7qpiBWW0eS2MeAqK
         MGvU/TPmoSU4MOBMSoSCVofCnUMlbfmxCVomgITrShWa5tlEOnnxZnUWLtiI+vsW2svf
         UIWTt7ABy/tezA3VQzN8m1ju5yEwqhxyozvKA=
Message-ID: <4AE6D1BD.8080005@gmail.com>
Date: Tue, 27 Oct 2009 17:55:57 +0700
From: Huy Phan <dachuy@gmail.com>
User-Agent: Thunderbird 2.0.0.23 (X11/20090817)
MIME-Version: 1.0
To: "Zhang Bingjun (Eddy)" <eddymier@gmail.com>
CC: common-user@hadoop.apache.org, core-user@hadoop.apache.org,
 hdfs-dev@hadoop.apache.org, hdfs-user@hadoop.apache.org
Subject: Re: Mount WebDav in Linux for HDFS-0.20.1
References: <b4e9dc6e0910270327w189cbfa7g1320c981efdfee5a@mail.gmail.com>
In-Reply-To: <b4e9dc6e0910270327w189cbfa7g1320c981efdfee5a@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Hi Zhang,

Here is the patch for davfs2 to solve "server does not support WebDAV" 
issue:

diff --git a/src/webdav.c b/src/webdav.c
index 8ec7a2d..4bdaece 100644
--- a/src/webdav.c
+++ b/src/webdav.c
@@ -472,7 +472,7 @@ dav_init_connection(const char *path)
 
     if (!ret) {
         initialized = 1;
-        if (!caps.dav_class1 && !caps.dav_class2 &&  !ignore_dav_header) {
+        if (!caps.dav_class1 && !ignore_dav_header) {
             if (have_terminal) {
                 error(EXIT_FAILURE, 0,
                       _("mounting failed; the server does not support 
WebDAV"));


davfs2 and webdav is not a good mix actually, I had tried to mix them 
together and the performance were really bad. With the load test of 10 
requests/s, load average on my namenode were always > 15 and it took me 
about 5 mins for `ls` the root directory of HDFS during the test.

Since you're using Hadoop 0.20.1, it's better to use fusedfs library 
provided in Hadoop package. You have to do some tricks to compile 
fusedfs with Hadoop, otherwise it would take you a lot of time for 
compiling redundant things.

Best,
Huy Phan

Zhang Bingjun (Eddy) wrote:
> Dear Huy Phan and others,
>
> Thanks a lot for your efforts in customizing the WebDav server 
> <http://github.com/huyphan/HDFS-over-Webdav> and make it work for 
> Hadoop-0.20.1. 
>
> After setting up the WebDav server, I could access it using Cadaver 
> client in Ubuntu without using any username password. Operations like 
> deleting files, etc, were working. The command is: *cadaver 
> http://server:9800*
>
> However, when I was trying to mount the WebDav server using davfs2 in 
> Ubuntu, I always get the following error: 
> "mount.davfs: mounting failed; the server does not support WebDAV".
>
> I was promoted to input username and password like below: 
> hadoop@hdfs2:/mnt$ sudo mount.davfs http://192.168.0.131:9800/test 
> hdfs-webdav/
> Please enter the username to authenticate with server
> http://192.168.0.131:9800/test or hit enter for none.
> Username: hadoop
> Please enter the password to authenticate user hadoop with server
> http://192.168.0.131:9800/test or hit enter for none.
> Password:
> mount.davfs: mounting failed; the server does not support WebDAV
>
> Even though I have tried all possible usernames and passwords either 
> from the WebDAV accounts.properties file or from the Ubuntu system of 
> the WebDAV server, I still got this error message. 
>
> Could you and anyone give me some hints on this problem? How could I 
> solve it? Very much appreciate your help!
>
> Best regards,
> Zhang Bingjun (Eddy)
>
> E-mail: eddymier@gmail.com <mailto:eddymier@gmail.com>, 
> bingjun@nus.edu.sg <mailto:bingjun@nus.edu.sg>, 
> bingjun@comp.nus.edu.sg <mailto:bingjun@comp.nus.edu.sg>
> Tel No: +65-96188110 (M)