Attention: We are retiring the ASP.NET Community Blogs. Learn more >

.NET Spider

I had been playing around with the idea of a Web Spider in .NET.  I had been throwing around some ideas in my mind.  Then this morning, I looked at an article in an old MSDN Mag issue (October 2002).  It had an article about a spider in it.  I downloaded it and it ran under VS.NET 2003.  I am really looking forward to diving into that code and taking a look at the code. 

Article

Wally

3 Comments

  • It's funny i spent a good 2 hours yesterday checking out for a good spidering library for .net. I need to write some custom scripts to download a paticularly unspider friendly site. ;)





    I even rememberd that MSDN Mag had carried a related article but the MSDN mag search really sucks.





    Anyways thanks a lot for the link :) :)

  • I want to checking out for a good spidering library for .net. I need to write some custom scripts to download a paticularly unspider friendly site.

  • i'm interesting to ASP.NET and SQL too
    and i have some Project regarding Spider and Crawler

    nadi_dubai@yahoo.com

Comments have been disabled for this content.