Back to playing with my Web Search Spider
Appropiate that this is my first post in 2006. I spent several hours this evening working getting my web search spider back up and going. I have it running on .NET 2.0 with Sql Server 2005. I need to go back and make a stored procedure change or two and it will be ready for me to scale it back up. I have it running on my 32 bit laptop right now. I am going to get it going in Win64 for x64. Things to do:
- Update a stored procedure to be more efficient.
- Cleanup some string processing that I do regarding urls.
- Move my MSMQ processing code from a winforms app to a Windows Service.
- Move my spider from a winforms app to a Windows Service.