httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joshua Slive <jsl...@gmail.com>
Subject Re: [users@httpd] MSN-Bot doesn't finish a download?
Date Tue, 03 May 2005 12:59:29 GMT
On 5/3/05, Abu Hurayrah <abu_hurayrah@almaghrib.org> wrote:
> I've tried sizes ranging from 50,000 bytes to 500,000 bytes, and always,
> MSN gets only that much.

It's very possible that the bot is interested in less than 50,000 bytes.

> 
> Previously, MSN would download the ENTIRE files, when I was sending
> these files all at once.  I cannot understand the mechanism that
> prevents it from continuing downloading the entire file, despite the
> fact that I partition the download into these discrete chunks.  I am not
> mangling the data in any way I know, I am simply sending it down in
> chunks to reduce the memory footprint of each of my download script's
> instances.

It is possible that the bot was always dropping the connection in the
same place, but you didn't know about it before because the rest of
the content would just get blindly sent.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message