It was a bit difficult to put this in the right category but I guess HTML was the best choice:
I am trying to figure out how you can block the w3 validator from accessing your site. As an example I looked at <a particular website>.
Go to http://validator.w3.org and enter the URl there and you see what I mean. It will show as “couldnt access page…… 403 forbidden”.
How did thy do this? Thought first it had to do with the robots….but it apparently is something else as I tried copying the robots into a test site…but after that the site could still be accessed by the validator. Read the rest of this entry »
Just a few questions and thoughts regarding the issue that I am wondering how can I know when it is time to add more servers to a balanced setup of web servers, database slave servers and master database?
The number seems to be from 10K to 15K users per web server, how can I know I am not over using the servers or not using them at full capacity?
Each web server has 16 processor with 32 GB of ram, each DB has same amount of processor, plus RAID 10 for the DB and 16GB of ram. All servers are interconnected on a private network with two nic cards; one nic for the public network and the other for the private.
I am just missing to implement memcached for the SQL objects and the HTML pages (an existing cache system is on place working like a charm for the HTML pages). Will this last “thing” push the limit from 10K/15K to 20K/30K per server?
If you guys have any thoughts – feel free to leave comment. Read the rest of this entry »