commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "F. Andy Seidl" <fase...@myst-technology.com>
Subject FW: File Upload Data Corruption Problem
Date Wed, 22 Aug 2007 15:25:06 GMT
>From: Tahir Akhtar
>
>Do the files that are corrupted ends up same at each upload or there is
>some randomness in that too?

[fas] There is randomness in how each file is corrupted.  See test results
below.

>Could it be something outside the file upload component, like disk
>problem or another process corrupting the file after it has been written
>on the server?

[fas] This seems unlikely.  This problem occurs on four different servers,
none of which are having any other signs of trouble.  As part of the tests
below, I uploaded a file and then (from a command line session) immediately
renamed the file.

[snip]

TEST RESULTS
------------

I uploaded a file, pincney_map.pdf, four times.  Immediately after each
upload, I renamed the file to 1.pdf, 2.pdf, etc.

Diff reports that each of the uploaded files differ from all the others.

I then downloaded the four uploaded pdf files (using WinSCP, which has
proven reliable for binary file transfer) to a Windows machine in order to
use the "comp" utility to determine where the first difference was between
each file using this simple script:

@echo off

comp pinckney_map.pdf 1.pdf
comp pinckney_map.pdf 2.pdf
comp pinckney_map.pdf 3.pdf
comp pinckney_map.pdf 4.pdf

comp 1.pdf 2.pdf
comp 1.pdf 3.pdf
comp 1.pdf 4.pdf
comp 2.pdf 3.pdf
comp 2.pdf 4.pdf
comp 3.pdf 4.pd

The output of that script follows:

Comparing pinckney_map.pdf and 1.pdf...
Compare error at OFFSET 1946
file1 = 1
file2 = 54
Compare error at OFFSET 1947
file1 = 17
file2 = 61
Compare error at OFFSET 1948
file1 = 4
file2 = D3
Compare error at OFFSET 1949
file1 = 40
file2 = 10
Compare error at OFFSET 194A
file1 = 58
file2 = 54
Compare error at OFFSET 194B
file1 = AA
file2 = 55
Compare error at OFFSET 194C
file1 = EB
file2 = BD
Compare error at OFFSET 194D
file1 = 3
file2 = 7D
Compare error at OFFSET 194E
file1 = B
file2 = 35
Compare error at OFFSET 194F
file1 = C3
file2 = 33
10 mismatches - ending compare

Comparing pinckney_map.pdf and 2.pdf...
Compare error at OFFSET 194C
file1 = EB
file2 = 55
Compare error at OFFSET 194D
file1 = 3
file2 = BD
Compare error at OFFSET 194E
file1 = B
file2 = 7D
Compare error at OFFSET 194F
file1 = C3
file2 = 35
Compare error at OFFSET 1950
file1 = 5C
file2 = 33
Compare error at OFFSET 1951
file1 = 15
file2 = 78
Compare error at OFFSET 1952
file1 = B4
file2 = 93
Compare error at OFFSET 1953
file1 = 77
file2 = 60
Compare error at OFFSET 1954
file1 = F
file2 = 16
Compare error at OFFSET 1955
file1 = 3
file2 = 99
10 mismatches - ending compare

Comparing pinckney_map.pdf and 3.pdf...
Compare error at OFFSET 1940
file1 = 7D
file2 = 20
Compare error at OFFSET 1941
file1 = D9
file2 = 35
Compare error at OFFSET 1942
file1 = 38
file2 = 59
Compare error at OFFSET 1943
file1 = 6D
file2 = 61
Compare error at OFFSET 1944
file1 = 78
file2 = 2C
Compare error at OFFSET 1945
file1 = EA
file2 = 54
Compare error at OFFSET 1946
file1 = 1
file2 = 61
Compare error at OFFSET 1947
file1 = 17
file2 = D3
Compare error at OFFSET 1948
file1 = 4
file2 = 10
Compare error at OFFSET 1949
file1 = 40
file2 = 54
10 mismatches - ending compare

Comparing pinckney_map.pdf and 4.pdf...
Compare error at OFFSET 1946
file1 = 1
file2 = 54
Compare error at OFFSET 1947
file1 = 17
file2 = 61
Compare error at OFFSET 1948
file1 = 4
file2 = D3
Compare error at OFFSET 1949
file1 = 40
file2 = 10
Compare error at OFFSET 194A
file1 = 58
file2 = 54
Compare error at OFFSET 194B
file1 = AA
file2 = 55
Compare error at OFFSET 194C
file1 = EB
file2 = BD
Compare error at OFFSET 194D
file1 = 3
file2 = 7D
Compare error at OFFSET 194E
file1 = B
file2 = 35
Compare error at OFFSET 194F
file1 = C3
file2 = 33
10 mismatches - ending compare

Comparing 1.pdf and 2.pdf...
Compare error at OFFSET 1946
file1 = 54
file2 = 1
Compare error at OFFSET 1947
file1 = 61
file2 = 17
Compare error at OFFSET 1948
file1 = D3
file2 = 4
Compare error at OFFSET 1949
file1 = 10
file2 = 40
Compare error at OFFSET 194A
file1 = 54
file2 = 58
Compare error at OFFSET 194B
file1 = 55
file2 = AA
Compare error at OFFSET 194C
file1 = BD
file2 = 55
Compare error at OFFSET 194D
file1 = 7D
file2 = BD
Compare error at OFFSET 194E
file1 = 35
file2 = 7D
Compare error at OFFSET 194F
file1 = 33
file2 = 35
10 mismatches - ending compare

Comparing 1.pdf and 3.pdf...
Compare error at OFFSET 1940
file1 = 7D
file2 = 20
Compare error at OFFSET 1941
file1 = D9
file2 = 35
Compare error at OFFSET 1942
file1 = 38
file2 = 59
Compare error at OFFSET 1943
file1 = 6D
file2 = 61
Compare error at OFFSET 1944
file1 = 78
file2 = 2C
Compare error at OFFSET 1945
file1 = EA
file2 = 54
Compare error at OFFSET 1946
file1 = 54
file2 = 61
Compare error at OFFSET 1947
file1 = 61
file2 = D3
Compare error at OFFSET 1948
file1 = D3
file2 = 10
Compare error at OFFSET 1949
file1 = 10
file2 = 54
10 mismatches - ending compare

Comparing 1.pdf and 4.pdf...
Compare error at OFFSET 16CA6
file1 = 25
file2 = C3
Compare error at OFFSET 16CA7
file1 = 44
file2 = D1
Compare error at OFFSET 16CA8
file1 = B5
file2 = 8E
Compare error at OFFSET 16CA9
file1 = B6
file2 = 20
Compare error at OFFSET 16CAA
file1 = 9D
file2 = F2
Compare error at OFFSET 16CAB
file1 = C5
file2 = 6B
Compare error at OFFSET 16CAC
file1 = BA
file2 = 63
Compare error at OFFSET 16CAD
file1 = C5
file2 = ED
Compare error at OFFSET 16CAE
file1 = CD
file2 = 98
Compare error at OFFSET 16CAF
file1 = EE
file2 = 12
10 mismatches - ending compare

Comparing 2.pdf and 3.pdf...
Compare error at OFFSET 1940
file1 = 7D
file2 = 20
Compare error at OFFSET 1941
file1 = D9
file2 = 35
Compare error at OFFSET 1942
file1 = 38
file2 = 59
Compare error at OFFSET 1943
file1 = 6D
file2 = 61
Compare error at OFFSET 1944
file1 = 78
file2 = 2C
Compare error at OFFSET 1945
file1 = EA
file2 = 54
Compare error at OFFSET 1946
file1 = 1
file2 = 61
Compare error at OFFSET 1947
file1 = 17
file2 = D3
Compare error at OFFSET 1948
file1 = 4
file2 = 10
Compare error at OFFSET 1949
file1 = 40
file2 = 54
10 mismatches - ending compare

Comparing 2.pdf and 4.pdf...
Compare error at OFFSET 1946
file1 = 1
file2 = 54
Compare error at OFFSET 1947
file1 = 17
file2 = 61
Compare error at OFFSET 1948
file1 = 4
file2 = D3
Compare error at OFFSET 1949
file1 = 40
file2 = 10
Compare error at OFFSET 194A
file1 = 58
file2 = 54
Compare error at OFFSET 194B
file1 = AA
file2 = 55
Compare error at OFFSET 194C
file1 = 55
file2 = BD
Compare error at OFFSET 194D
file1 = BD
file2 = 7D
Compare error at OFFSET 194E
file1 = 7D
file2 = 35
Compare error at OFFSET 194F
file1 = 35
file2 = 33
10 mismatches - ending compare

Comparing 3.pdf and 4.pdf...
Compare error at OFFSET 1940
file1 = 20
file2 = 7D
Compare error at OFFSET 1941
file1 = 35
file2 = D9
Compare error at OFFSET 1942
file1 = 59
file2 = 38
Compare error at OFFSET 1943
file1 = 61
file2 = 6D
Compare error at OFFSET 1944
file1 = 2C
file2 = 78
Compare error at OFFSET 1945
file1 = 54
file2 = EA
Compare error at OFFSET 1946
file1 = 61
file2 = 54
Compare error at OFFSET 1947
file1 = D3
file2 = 61
Compare error at OFFSET 1948
file1 = 10
file2 = D3
Compare error at OFFSET 1949
file1 = 54
file2 = 10
10 mismatches - ending compare




---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org


Mime
View raw message