I am writing CaveSpider, spidering software with indexing. The purpose is to download binaries for grabbing tools off the net. Here's the base code, made for Squeak Smalltalk (file th*.st files in) :

https://github.com/zork9/smalltalk