License: MIT
Homepage: http://cl-web-crawler.googlecode.com/
It definitely works for SBCL, it probably works for other lisps as well. Little attention has been paid to efficiency, but since this is the only web-crawling library I can find for CL, hopefully it will get better.
Patches are very welcome!
web HTTP Client