Looking at the logs it looks like it was just Google and MSN spidering the hell out of the site at the same time. I'll try to look into a way to only allow them to have one session at a time, instead of sending 150 spiders at the same time to the site.
Danny, You need to put a files called robots.txt in the web root (ie. www.priuschat.com/robots.txt). Robots.txt is a simple text file that you upload to the root directory of your website. Spiders read this file first, and process it, before they crawl your site. # robots.txt for http://www.priuschat.com # the idea is to block off all access except what you want spiders to see User-agent: * Disallow: /_notes/ Disallow: /bin/ Disallow: /classifieds/ Disallow: /faqs/ Disallow: /forum/ Disallow: /gallery/ Disallow: /logs/ Disallow: /memorabilia/ Disallow: /resources/ Disallow: /stats/ Disallow: /Templates/ Basically, I deny ALL the directories on my sites. I leave one or two html files that contain the keywords I want spiders to use to identify my site. Don
A curious thing that I've have found that one of you computer gurus might be able to answer is that at work running FF, PC is horribly slow ("1200 baud" like slow) IE runs at an acceptable load rate for the 100Mbps connection that I have. At home no problem with FF.
Clear the cache... FF is great (I use it), but I've noticed the cache access times aren't the best...
That's why you leave some html files with the keywords for the spiders to access. And you cen be very specific on the keywords by using META tags for the content... spiders will index their results on them. Example from one of my WWW sites: <META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=windows-8859-1"> <META NAME="Description" CONTENT="Elec-Trak, Wheelhorse, and New Idea Electric Tractor resource site."> <META NAME="Keywords" CONTENT="elec-trak, wheelhorse, new idea, electric tractor, club, resources, manuals, parts, info, GE Elec-Trak, electrak, green tractors, enviromentally frendly, GE, E-15, E-20, E-12, E-12M, E-8, General Electric, B-145">
dbarry, Wish it was as simple as clearing the cache. Doesn't speed up PC on FF at the office. By the way it PC on FF loads slower with the 100Mbps at the office than it does with a "regular" 52k modem hookup at home. (same machine, a laptop)