License: MIT
Homepage: https://code.google.com/archive/p/cl-web-crawler/
It definitely works for SBCL, it probably works for other lisps as well. Little attention has been paid to efficiency, but since this is the only web-crawling library I can find for CL, hopefully it will get better.
Patches are very welcome!
web HTTP Client