My blogging philosophy and my need to analyse my referral log

One of the primary reasons that I blog is to help the community, I don't really expect anyone to directly subscribe to by blog (just out of curiosity does anyone?). I depend on people finding my information through search engines. Most of my posts are technical things that for what ever reason I spent some time figuring out how to accomplish.

Like most people when I try to figure out how to do something I first do a google search and most of the time I can find what I'm looking for pretty quickly but there are times when I wish the information was easier to find. Those times are what most of my blog entries deal with. If I figure out a solution to that particular problem and it is easily bloggable then I will post a blog entry about it. The hope is that if anyone else has a similar problem I will save them the time that it took me to figure out the problem. Of course there is also a time issue, I obviously don't have time to post every solution that I figure out but I try to post or queue up the ones I believe will be the most helpful. For my blog queue I actually have a separate task items folder in Outlook so that if I have an idea for a post I will add a new task with a quick note about the idea.

So in order to determine if my blog is getting the correct google searches I want to analyze my referral log. I know I can manually check my referrals through the admin interface but has anyone written or know of any little utilities that will gather and parse all my referrals and give me some stats about the google searches that found my blog? If no one knows of any then I may try to write one when I get time.

Published Sunday, August 15, 2004 5:19 PM by puzzlehacker

Comments

# RE: My blogging philosophy and my need to analyse my referral log

If you had access to the actual web logs, there are plenty of log analyzers ranging from free to thousands of dollars. If not, there are also plenty of embedded trackers which simply require you to add an image file to each page (just place in a common section). The file actually exists on a third party site which analyzes its log file requests for that image and provides back the report. They also start for free and go up from there depending on number of hits and features.

Personally, I use WebLog Expert which is nicely priced but gives me some advanced functions like downloading my log files via FTP automatically.

Sunday, August 15, 2004 6:26 PM by don@ghostdev.ca (Don Newman)

# re: My blogging philosophy and my need to analyse my referral log

Unfortunately I don't have access the log files directly only the referral log given in the admin interface to this blog.

Sunday, August 15, 2004 6:35 PM by Wes

# RE: My blogging philosophy and my need to analyse my referral log

Then I suggest going with the second option of putting a tracker image on each page. You can google for free web tracker which should give you tons of options to go through and find one with the features you want.

Sunday, August 15, 2004 7:15 PM by don@ghostdev.ca (Don Newman)

# re: My blogging philosophy and my need to analyse my referral log

Why not host your blog on your own site? You can have a personalized domain name like, WesHaggard.com, if that gets you excited.

What's important, though, is that you would have direct access to the log files, so you could parse those using any # of programs, as Don mentioned. I run a number of .Text blogs through WebHost4Life and have been pleased with the cost/perf/uptime. (A more in-depth review at: http://scottonwriting.net/sowBlog/posts/1187.aspx)

Monday, August 16, 2004 2:06 PM by Scott Mitchell

# re: My blogging philosophy and my need to analyse my referral log

refer.vbs:
Set re = New RegExp
re.Pattern = "a href=""http:\/\/[^>]*google[^>]*q=([^&""<]*)[&""<]"
re.Global = True
Set HTTP = CreateObject("Microsoft.XMLHTTP")
URL = "http://weblogs.asp.net/whaggard/admin/Referrers.aspx?pg="
For page = 1 to NUMBEROFPAGES
HTTP.Open "GET", URL & page, False
HTTP.Send
Set matches = Re.Execute(HTTP.ResponseText)
If Not Matches Is Nothing Then
For Each Match in Matches
For Each SubMatch In Match.SubMatches
WScript.Echo SubMatch
Next
Next
End If
Next

Change NUMBEROFPAGES to the amount of referal pages in your logs :)

redirect the output to a txt file and you got all your google queries :)

Monday, August 16, 2004 2:16 PM by David Cumps

# re: My blogging philosophy and my need to analyse my referral log

Don, Scott, thanks for the info.
I know I could track all my stuff through the web server log files but I didn't really want to go that route.

David, thanks for the script, that is more along the lines of what I was looking for, but I was hoping that since .Text already has the referrals then I could just get them via a webservice or something.

Monday, August 16, 2004 2:28 PM by Wes

# Over 100,000 hits

Sunday, January 23, 2005 11:35 PM by TrackBack

Leave a Comment

(required) 
(required) 
(optional)
(required)