Proxy Search Engine Hell!
If you run a proxy site you probably know all about high bandwidth usage and big server loads! Those starting out probably don’t know that not only do you have to worry about the bandwidth your proxy uses you should also be concerned with the server load caused by a large number of people browsing through your proxy site(s).
Recently I found one of my proxy sites was causing an abnormally high server load and decided to check into the problem turns out GOOGLE was bombing my site! Basically the google bot was going to so many pages proxified through my proxy it was almost overloading my server! Google was hitting 70,000+ pages per-day on my site and using 1-2gb of bandwidth PER-DAY! Unlike most websites this is not good for a proxy based website because like I previously mentioned google can literraly take down your server and you DO NOT benefit nearly as much from someone visiting a proxified page from google than you do if they go to your proxy’s homepage with your ads and money earners 
on display.
So how do you fix this problem and prevent google from spydering your site? Simple! (more…)
Proxy Network Update
Well my new Dual 3.0ghz Woodcrest server is running great! The loads barely spike 2.0 during peak usage and during the rest of the day are well under 1.0!! This is VERY exciting because my previous Dual Xeon 2.8ghz box was spiking to above 30.0 and loads during the day were never under 3!
My new box nicknamed “Woody” (for the processor sickos!) only has 2gb of ram so I could really speed it up by adding a total of 14gb *GASP* more ram!!!
I have around 10 proxy sites (domains) on the server and about two or three account for 90% of the server load and income.
New Project, proxy network!
So I’ve decided to expand my almost year old proxy sites into a complete proxy network!
I’ve got a business plan, profit model and have started by leasing a new very powerful dedicated server. I also have coded a lot of php tweaks and add-ons for the phproxy software to make it run faster and use less system resources.
For the geeks out there the new dedicated server is a dual 5160 woodcrest 