commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Kornmesser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (VFS-428) DavException: (301) Moved Permanently
Date Sun, 22 Jul 2012 12:49:34 GMT

    [ https://issues.apache.org/jira/browse/VFS-428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420153#comment-13420153
] 

Robert Kornmesser commented on VFS-428:
---------------------------------------

??Are you saying that VFS should add a / to certain requests? Which ones???
Yes and no. For sure requests to directories have to have a trailing slash. But of course
VFS does not know at request level wich request is a possible directory. But Maybe the root
request has to be a directory. so that this request should end with a /. From the root level
on, VFS should know the directory structure.

??Are you saying that this is a code bug or a documentation bug???
Imho both! Requests to directories should either end with a trailing slash or the httpclient
should be configurable to follow redirects. The documentation mentioned at http://commons.apache.org/vfs/testserver.html
cann not work with the current code.

??Should VFS offer an option to follow redirects???
Yes, would be nice. I dont really know the webdav internals, why this denied by default.

??Can you post your whole configuration with instructions such that it can be reproduced by
anyone???
*Webdav-Server*
* Apache HTTPD 2.2.22
* {code:title=/etc/apache2/conf.d/vfstest.conf|borderStyle=solid}
Alias /vfstest /vfstest/

DAVLockDB /var/lib/apache2/dav.lockDB
DAVMinTimeout 600

<Directory /vfstest>
    Options None
    AllowOverride None
    Order allow,deny
    Allow from all
</Directory>

<Location />
        DAV On
        Options Indexes MultiViews
        AllowOverride None

        AuthType Basic
        AuthName vfstest_zone
        AuthUserFile /etc/apache2/passwd
        <Limit PUT POST DELETE PROPFIND PROPPATCH MKCOL COPY MOVE LOCK UNLOCK>
                Require user vfsusr
        </Limit>
</Location>
{code}
* htpasswd2 -cmb /etc/apache2/passwd  vfsusr 'vfstest'
* {code:title=ls -R /vfstest/|borderStyle=solid}
/vfstest/:
insgesamt 3204
drwxr-xr-x 4 http http    4096 16. Jul 17:14 .
drwxr-xr-x 3 http http    4096 16. Jul 11:11 ..
-rw-r--r-- 1 http http 3130982 16. Jul 17:14 largefile.tar.gz
-rw-r--r-- 1 http http    1858 16. Jul 17:14 nested.jar
-rw-r--r-- 1 http http   40960 16. Jul 17:14 nested.tar
-rw-r--r-- 1 http http    1317 16. Jul 17:14 nested.tbz2
-rw-r--r-- 1 http http    1159 16. Jul 17:14 nested.tgz
-rw-r--r-- 1 http http    5028 16. Jul 17:14 nested.zip
drwxr-xr-x 3 http http    4096 16. Jul 17:14 read-tests
-rw-r--r-- 1 http http     106 16. Jul 17:14 test-hash-#test.txt
-rw-r--r-- 1 http http    4710 16. Jul 17:14 test.jar
-rw-r--r-- 1 http http     254 16. Jul 17:14 test.mf
-rw-r--r-- 1 http http    3211 16. Jul 17:14 test.policy
-rw-r--r-- 1 http http   30720 16. Jul 17:14 test.tar
-rw-r--r-- 1 http http     918 16. Jul 17:14 test.tbz2
-rw-r--r-- 1 http http    1001 16. Jul 17:14 test.tgz
-rw-r--r-- 1 http http    4880 16. Jul 17:14 test.zip
drwxr-xr-x 2 http http    4096 16. Jul 17:14 write-tests

/vfstest/read-tests:
insgesamt 24
drwxr-xr-x 3 http http 4096 16. Jul 17:14 .
drwxr-xr-x 4 http http 4096 16. Jul 17:14 ..
drwxr-xr-x 5 http http 4096 16. Jul 17:14 dir1
-rw-r--r-- 1 http http    0 16. Jul 17:14 empty.txt
-rw-r--r-- 1 http http   20 16. Jul 17:14 file1.txt
-rw-r--r-- 1 http http   20 16. Jul 17:14 file space.txt
-rw-r--r-- 1 http http   20 16. Jul 17:14 file%.txt

/vfstest/read-tests/dir1:
insgesamt 32
drwxr-xr-x 5 http http 4096 16. Jul 17:14 .
drwxr-xr-x 3 http http 4096 16. Jul 17:14 ..
-rw-r--r-- 1 http http   12 16. Jul 17:14 file1.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file2.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file3.txt
drwxr-xr-x 2 http http 4096 16. Jul 17:14 subdir1
drwxr-xr-x 2 http http 4096 16. Jul 17:14 subdir2
drwxr-xr-x 2 http http 4096 16. Jul 17:14 subdir3

/vfstest/read-tests/dir1/subdir1:
insgesamt 20
drwxr-xr-x 2 http http 4096 16. Jul 17:14 .
drwxr-xr-x 5 http http 4096 16. Jul 17:14 ..
-rw-r--r-- 1 http http   12 16. Jul 17:14 file1.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file2.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file3.txt

/vfstest/read-tests/dir1/subdir2:
insgesamt 20
drwxr-xr-x 2 http http 4096 16. Jul 17:14 .
drwxr-xr-x 5 http http 4096 16. Jul 17:14 ..
-rw-r--r-- 1 http http   12 16. Jul 17:14 file1.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file2.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file3.txt

/vfstest/read-tests/dir1/subdir3:
insgesamt 20
drwxr-xr-x 2 http http 4096 16. Jul 17:14 .
drwxr-xr-x 5 http http 4096 16. Jul 17:14 ..
-rw-r--r-- 1 http http   12 16. Jul 17:14 file1.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file2.txt
-rw-r--r-- 1 http http   12 16. Jul 17:14 file3.txt

/vfstest/write-tests:
insgesamt 12
drwxr-xr-x 2 http http 4096 16. Jul 17:14 .
drwxr-xr-x 4 http http 4096 16. Jul 17:14 ..
-rw-r--r-- 1 http http   44 16. Jul 17:14 dummy.txt
{code}
* svn co http://svn.apache.org/repos/asf/commons/proper/vfs/tags/commons-vfs2-project-2.0/core/
/tmp/vfs2
* cd /tmp/vfs2
* {code:title=src/test/resources/log4j.properties|borderStyle=solid}

log4j.rootLogger=DEBUG, R
log4j.appender.R=org.apache.log4j.ConsoleAppender
log4j.appender.R.layout=org.apache.log4j.PatternLayout
og4j.appender.R.layout.ConversionPattern=%-4r %-5p [%t] %37c %3x - %m%n
{code}
* mvn -P webdav clean test -Dtest.webdav.uri=webdav://vfsusr:vfstest@localhost/vfstest -Dtest=WebdavProviderTestCase
* Result:
{code}

 T E S T S
-------------------------------------------------------
Running org.apache.commons.vfs2.provider.webdav.test.WebdavProviderTestCase
Using "/tmp/vfs2/target/test-classes/test-data/temp" as temporary files store.
Set parameter http.useragent = Jakarta Commons-HttpClient/3.1
Set parameter http.protocol.version = HTTP/1.1
Set parameter http.connection-manager.class = class org.apache.commons.httpclient.SimpleHttpConnectionManager
Set parameter http.protocol.cookie-policy = default
Set parameter http.protocol.element-charset = US-ASCII
Set parameter http.protocol.content-charset = ISO-8859-1
Set parameter http.method.retry-handler = org.apache.commons.httpclient.DefaultHttpMethodRetryHandler@1c8a1c9d
Set parameter http.dateparser.patterns = [EEE, dd MMM yyyy HH:mm:ss zzz, EEEE, dd-MMM-yy HH:mm:ss
zzz, EEE MMM d HH:mm:ss yyyy, EEE, dd-MMM-yyyy HH:mm:ss z, EEE, dd-MMM-yyyy HH-mm-ss z, EEE,
dd MMM yy HH:mm:ss z, EEE dd-MMM-yyyy HH:mm:ss z, EEE dd MMM yyyy HH:mm:ss z, EEE dd-MMM-yyyy
HH-mm-ss z, EEE dd-MMM-yy HH:mm:ss z, EEE dd MMM yy HH:mm:ss z, EEE,dd-MMM-yy HH:mm:ss z,
EEE,dd-MMM-yyyy HH:mm:ss z, EEE, dd-MM-yyyy HH:mm:ss z]
Java version: 1.7.0_05
Java vendor: Oracle Corporation
Java class path: /tmp/vfs2/target/test-classes:/tmp/vfs2/target/classes:/home/setti/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/home/setti/.m2/repository/ant/ant/1.6.2/ant-1.6.2.jar:/home/setti/.m2/repository/commons-net/commons-net/2.2/commons-net-2.2.jar:/home/setti/.m2/repository/org/apache/commons/commons-compress/1.1/commons-compress-1.1.jar:/home/setti/.m2/repository/commons-collections/commons-collections/3.1/commons-collections-3.1.jar:/home/setti/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/setti/.m2/repository/commons-codec/commons-codec/1.2/commons-codec-1.2.jar:/home/setti/.m2/repository/org/apache/jackrabbit/jackrabbit-webdav/1.5.2/jackrabbit-webdav-1.5.2.jar:/home/setti/.m2/repository/org/apache/jackrabbit/jackrabbit-jcr-commons/1.5.2/jackrabbit-jcr-commons-1.5.2.jar:/home/setti/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/home/setti/.m2/repository/junit/junit/4.8.2/junit-4.8.2.jar:/home/setti/.m2/repository/org/slf4j/slf4j-api/1.5.6/slf4j-api-1.5.6.jar:/home/setti/.m2/repository/org/slf4j/slf4j-log4j12/1.5.6/slf4j-log4j12-1.5.6.jar:/home/setti/.m2/repository/log4j/log4j/1.2.14/log4j-1.2.14.jar:/home/setti/.m2/repository/org/apache/maven/scm/maven-scm-api/1.4/maven-scm-api-1.4.jar:/home/setti/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.6/plexus-utils-1.5.6.jar:/home/setti/.m2/repository/org/apache/maven/scm/maven-scm-provider-svnexe/1.4/maven-scm-provider-svnexe-1.4.jar:/home/setti/.m2/repository/org/apache/maven/scm/maven-scm-provider-svn-commons/1.4/maven-scm-provider-svn-commons-1.4.jar:/home/setti/.m2/repository/regexp/regexp/1.3/regexp-1.3.jar:
Operating system name: Linux
Operating system architecture: amd64
Operating system version: 3.4.5-1-ARCH
SUN 1.7: SUN (DSA key/parameter generation; DSA signing; SHA-1, MD5 digests; SecureRandom;
X.509 certificates; JKS keystore; PKIX CertPathValidator; PKIX CertPathBuilder; LDAP, Collection
CertStores, JavaPolicy Policy; JavaLoginConfig Configuration)
SunRsaSign 1.7: Sun RSA signature provider
SunEC 1.7: Sun Elliptic Curve provider (EC, ECDSA, ECDH)
SunJSSE 1.7: Sun JSSE provider(PKCS12, SunX509 key/trust factories, SSLv3, TLSv1)
SunJCE 1.7: SunJCE Provider (implements RSA, DES, Triple DES, AES, Blowfish, ARCFOUR, RC2,
PBE, Diffie-Hellman, HMAC)
SunJGSS 1.7: Sun (Kerberos v5, SPNEGO)
SunSASL 1.7: Sun SASL provider(implements client mechanisms for: DIGEST-MD5, GSSAPI, EXTERNAL,
PLAIN, CRAM-MD5, NTLM; server mechanisms for: DIGEST-MD5, GSSAPI, CRAM-MD5, NTLM)
XMLDSig 1.0: XMLDSig (DOM XMLSignatureFactory; DOM KeyInfoFactory)
SunPCSC 1.7: Sun PC/SC provider
Set parameter http.connection-manager.max-per-host = {HostConfiguration[host=http://localhost]=5}
Set parameter http.connection-manager.max-total = 50
HttpConnectionManager.getConnection:  config = HostConfiguration[host=http://localhost], timeout
= 0
Allocating new connection, hostConfig=HostConfiguration[host=http://localhost]
Open connection to localhost:80
>> "HEAD / HTTP/1.1[\r][\n]"
Adding Host request header
>> "User-Agent: Jakarta Commons-HttpClient/3.1[\r][\n]"
>> "Host: localhost[\r][\n]"
>> "[\r][\n]"
<< "HTTP/1.1 200 OK[\r][\n]"
<< "HTTP/1.1 200 OK[\r][\n]"
<< "Date: Sun, 22 Jul 2012 12:45:12 GMT[\r][\n]"
<< "Server: Apache/2.2.22 (Unix) mod_ssl/2.2.22 OpenSSL/1.0.1c DAV/2 PHP/5.4.5[\r][\n]"
<< "Content-Type: text/html;charset=ISO-8859-1[\r][\n]"
<< "[\r][\n]"
Resorting to protocol version default close connection policy
Should NOT close connection, using HTTP/1.1
Releasing connection back to connection manager.
Freeing connection, hostConfig=HostConfiguration[host=http://localhost]
Adding connection at: 1342961112824
Notifying no-one, there are no waiting threads
putFile: webdav://vfsusr:vfstest@localhost/vfstest
putFile: webdav://vfsusr:vfstest@localhost/vfstest/read-tests
putFile: webdav://vfsusr:vfstest@localhost/vfstest/write-tests
HttpConnectionManager.getConnection:  config = HostConfiguration[host=http://localhost], timeout
= 0
Getting free connection, hostConfig=HostConfiguration[host=http://localhost]
>> "PROPFIND /vfstest/read-tests HTTP/1.1[\r][\n]"
Adding Host request header
>> "Depth: 0[\r][\n]"
>> "User-Agent: Jakarta-Commons-VFS[\r][\n]"
>> "Cache-control: no-cache[\r][\n]"
>> "Cache-store: no-store[\r][\n]"
>> "Pragma: no-cache[\r][\n]"
>> "Expires: 0[\r][\n]"
>> "Host: localhost[\r][\n]"
>> "Content-Length: 112[\r][\n]"
>> "Content-Type: text/xml; charset=UTF-8[\r][\n]"
>> "[\r][\n]"
>> "<?xml version="1.0" encoding="UTF-8"?><D:propfind xmlns:D="DAV:"><D:prop><D:resourcetype/></D:prop></D:propfind>"
Request body sent
<< "HTTP/1.1 401 Authorization Required[\r][\n]"
<< "HTTP/1.1 401 Authorization Required[\r][\n]"
<< "Date: Sun, 22 Jul 2012 12:45:12 GMT[\r][\n]"
<< "Server: Apache/2.2.22 (Unix) mod_ssl/2.2.22 OpenSSL/1.0.1c DAV/2 PHP/5.4.5[\r][\n]"
<< "WWW-Authenticate: Basic realm="vfstest_zone"[\r][\n]"
<< "Vary: accept-language,accept-charset[\r][\n]"
<< "Accept-Ranges: bytes[\r][\n]"
<< "Content-Length: 589[\r][\n]"
<< "Content-Type: text/html; charset=iso-8859-1[\r][\n]"
<< "Content-Language: en[\r][\n]"
<< "[\r][\n]"
Authorization required
Supported authentication schemes in the order of preference: [ntlm, digest, basic]
Challenge for ntlm authentication scheme not available
Challenge for digest authentication scheme not available
basic authentication scheme selected
Using authentication scheme: basic
Authorization challenge processed
Authentication scope: BASIC 'vfstest_zone'@localhost:80
Retry authentication
<< "<!--#set var="TITLE" value="Authentication required!"[\n]"
<< "--><!--#include virtual="include/top.html" -->[\n]"
<< "[\n]"
<< "    This server could not verify that you are authorized to access[\n]"
<< "    the URL "<!--#echo encoding="url" var="REDIRECT_URL" -->".[\n]"
<< "    You either supplied the wrong credentials (e.g., bad password), or your[\n]"
<< "    browser doesn't understand how to supply the credentials required.[\n]"
<< "[\n]"
<< "  <!--#include virtual="include/spacer.html" -->[\n]"
<< "[\n]"
<< "    In case you are allowed to request the document, please[\n]"
<< "    check your user-id and password and try again.[\n]"
<< "[\n]"
<< "<!--#include virtual="include/bottom.html" -->[\n]"
Resorting to protocol version default close connection policy
Should NOT close connection, using HTTP/1.1
Authenticating with BASIC 'vfstest_zone'@localhost:80
Credential charset not configured, using HTTP element charset
>> "PROPFIND /vfstest/read-tests HTTP/1.1[\r][\n]"
Adding Host request header
>> "Depth: 0[\r][\n]"
>> "User-Agent: Jakarta-Commons-VFS[\r][\n]"
>> "Cache-control: no-cache[\r][\n]"
>> "Cache-store: no-store[\r][\n]"
>> "Pragma: no-cache[\r][\n]"
>> "Expires: 0[\r][\n]"
>> "Content-Length: 112[\r][\n]"
>> "Content-Type: text/xml; charset=UTF-8[\r][\n]"
>> "Authorization: Basic dmZzdXNyOnZmc3Rlc3Q=[\r][\n]"
>> "Host: localhost[\r][\n]"
>> "[\r][\n]"
>> "<?xml version="1.0" encoding="UTF-8"?><D:propfind xmlns:D="DAV:"><D:prop><D:resourcetype/></D:prop></D:propfind>"
Request body sent
<< "HTTP/1.1 301 Moved Permanently[\r][\n]"
<< "HTTP/1.1 301 Moved Permanently[\r][\n]"
<< "Date: Sun, 22 Jul 2012 12:45:12 GMT[\r][\n]"
<< "Server: Apache/2.2.22 (Unix) mod_ssl/2.2.22 OpenSSL/1.0.1c DAV/2 PHP/5.4.5[\r][\n]"
<< "Location: http://localhost/vfstest/read-tests/[\r][\n]"
<< "Content-Length: 363[\r][\n]"
<< "Content-Type: text/html; charset=iso-8859-1[\r][\n]"
<< "[\r][\n]"
Redirect required
<< "<"
<< "!"
<< "D"
<< "O"
<< "CTYPE HTML PUBLIC "-//IETF//"
<< "DTD HTML 2.0//EN">[\n]"
<< "<html><head>[\n]"
<< "<title>301 Moved Permanently</title>[\n]"
<< "</head><body>[\n]"
<< "<h1>Moved Permanently</h1>[\n]"
<< "<p>The document has moved <a href="http://localhost/vfstest/read-tests/">here</a>.</p>[\n]"
<< "<hr>[\n]"
<< "<address>Apache/2.2.22 (Unix) mod_ssl/2.2.22 OpenSSL/1.0.1c DAV/2 PHP/5.4.5
Server at localhost Port 80</address>[\n]"
<< "</body></html>[\n]"
Resorting to protocol version default close connection policy
Should NOT close connection, using HTTP/1.1
Releasing connection back to connection manager.
Freeing connection, hostConfig=HostConfiguration[host=http://localhost]
Adding connection at: 1342961112947
Notifying no-one, there are no waiting threads
DavException: (301) Moved Permanently
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.449 sec <<< FAILURE!

Results :

Tests in error: 
  junit.framework.TestSuite@3a2128d0(org.apache.commons.vfs2.provider.webdav.test.WebdavProviderTestSuite):
Could not determine the type of file "webdav://vfsusr:***@localhost/vfstest/read-tests".

Tests run: 1, Failures: 0, Errors: 1, Skipped: 0
{code}
                
> DavException: (301) Moved Permanently 
> --------------------------------------
>
>                 Key: VFS-428
>                 URL: https://issues.apache.org/jira/browse/VFS-428
>             Project: Commons VFS
>          Issue Type: Bug
>    Affects Versions: 2.0, 2.1
>         Environment: Apache 2.2.22 as Testerver and setted up like http://commons.apache.org/vfs/testserver.html
(but changed the 'crypt' password)
>            Reporter: Robert Kornmesser
>            Priority: Blocker
>              Labels: webdav
>
> Running the WebdavProviderTestCase using mvn -P webdav clean test -Dtest.webdav.uri=webdav://vfsusr:vfstest@localhost/vfstest
-Dtest=WebdavProviderTestCase results in 
> {code}DavException: (301) Moved Permanently
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.645 sec <<<
FAILURE!
> Results :
> Tests in error: 
>   junit.framework.TestSuite@55c9be00(org.apache.commons.vfs2.provider.webdav.test.WebdavProviderTestCase$1):
Could not determine the type of file "webdav://vfsusr:****@localhost/vfstest/read-tests".
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0
> {code}
> The deeper Problem is, that the HttpClient using by VFS does not append a trailing slash
and mod_dir of httpd has "DirectorySlash On" per default. So httpd send 301 redirect to the
same url with / appended.
> I know that for this reason of problematic webdav client apache introduced "redirect-carefully"
for some user agents using the "BrowserMatch" directive. So I just tried adding the following
into my <Directory> directive
> {code}
> BrowserMatch "^Jakarta-Commons-VFS" redirect-carefully
> BrowserMatch "^Jakarta Commons-HttpClient/3.0" redirect-carefully
> BrowserMatch "^Jakarta Commons-HttpClient/3.1" redirect-carefully
> {code}
> Its needed to have Jakarta-Commons-VFS *and* Jakarta Commons-HttpClient because of two
requests from commons vfs using two different user agents.
> But instead of solving the issue, I get for every FileObject.getChildren() call at least
one FileObject of type imaginary with the same basename as the parent. Thats not a problem
at all (besides that this is totally wrong!) but deleting a parent just dont work anymore,
because of an *non-existent* imaginary file inside the dir which cannot be deleted of course.
> To cut a long story short, what is the right httpd webdav server config to use 2.0 Release
version of VFS?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message