I had been playing around with the idea of a Web Spider in .NET. I had been throwing around some ideas in my mind. Then this morning, I looked at an article in an old MSDN Mag issue (October 2002). It had an article about a spider in it. I downloaded it and it ran under VS.NET 2003. I am really looking forward to diving into that code and taking a look at the code.