Got a neat tip today from the boss! Consider the following Explorer view:
Now right-click on one of the column headers and select "More...":
Select the column "File Version". NOTE: Under Win2K it will be "Module Version".
Close the dialog and now you get your .NET assembly versions listed in Explorer!
Unfortunately, this is a "per folder" setting so it only shows up where you set it up.