Archives / 2003 / May
  • .NET Spider

    I had been playing around with the idea of a Web Spider in .NET.  I had been throwing around some ideas in my mind.  Then this morning, I looked at an article in an old MSDN Mag issue (October 2002).  It had an article about a spider in it.  I downloaded it and it ran under VS.NET 2003.  I am really looking forward to diving into that code and taking a look at the code.