send in your httpget problems

[Golda Velez <gvelez@tucson.com>]

I don't know how many people are aware, but httpget.c has some pretty
significant shortcomings & bugs:  for example, it doesn't submit
usernames/passwords, and it is hangs on some URL's with loop conditions, etc.

Vineel Kumar Gattu and Jayaprakash Rudraraju will be working on it this
next few weeks, so please everyone send in any good failing cases you might
have.  Hopefully we can get it much more robust so that people trying to
index 1000's of sites will not run into sporadic problems.

Thanks!

Golda
------------------------------------------------------------
Golda Velez         gvelez@tucson.com	        520-620-6878
Internet Workshop                          http://tucson.com
Webglimpse Search Software             http://webglimpse.net
		~~~~~~~~~~~~~~~~~~~~~~~~~~~
 Help organize the world - index your own corner of the web