| Author |
Message |
Rashy
Lifeless Person
Joined: 25 Sep 2006
Posts: 632
|
 Posted: Sun Sep 16, 2007 1:01 am Post subject: Digg Effect? |
 |
|
Could the lifeless server (aesir specifically) withstand the digg effect? A front page wouldn't crash the server, would it?
I suppose it also depends on the script that gets hit  Running on the latest install of Wordpress. Average page size of around 150 kb (but depends on how many images of course, so it could fluctuate quite a bit, front page is 50kb).
I got a sponsor type thing and he wants to know 
_________________
Rashy! |
|
| Back to top |
|
| |
ClickFanatic
Est. 2005
Joined: 18 Jan 2005
Posts: 3857
|
| Posted: Sun Sep 16, 2007 3:28 am Post subject: |
|
|
It has been affected by Digg before, and it went down.
In theory, the server can withstand the effect, but the site that got Dugg was running Joomla (aka pretty 'heavy' CMS, when it's hit a 10,000 and more times per hour).
A static HTML page is much better, as it requires (close to) zero pre-processing.
Other factors are HTTP requests per page. You should take into account that each Digg visit arrives with an empty cache (as far as your site is concerned). So all the stylesheets, images, javascript and whatnot linked from within your page have to be requested.
If one page results in, say, 12 more requests, this is exponentially increasing the effect of Digg visits.
If you want a website that is Digg effect proof, then try to find a host that guarantees such a service. Be prepared to pay a lot of money, though.
As far as normal hosted sites go: be sure to prepare a lightweight static page.
_________________
Captain Jell-O Buster from the Future
[img]http://feeds.feedburner.com/sparepencil.1.gif[/img] |
|
| Back to top |
|
| |
krt
...
Joined: 11 Jan 2005
Posts: 4607
Location: Australia
|
| Posted: Sun Sep 16, 2007 5:35 am Post subject: |
|
|
All you have to do is use caching and compression. Each dynamic web page in your site should have a cached and maybe even gzipped version that is updated periodically or when the content is modified.
Other things that help are minimising HTML, CSS and JS, compressing images further, combining CSS/JS into one request for each, using sprites, referer checking and serving simple versions of the page to digg users etc.
| Quote: | | If one page results in, say, 12 more requests, this is exponentially increasing the effect of Digg visits. |
Exponentially? Are you sure? |
|
| Back to top |
|
| |
ClickFanatic
Est. 2005
Joined: 18 Jan 2005
Posts: 3857
|
| Posted: Sun Sep 16, 2007 5:39 am Post subject: |
|
|
| krt wrote: | All you have to do is use caching and compression. Each dynamic web page in your site should have a cached and maybe even gzipped version that is updated periodically or when the content is modified.
Other things that help are minimising HTML, CSS and JS, compressing images further, combining CSS/JS into one request for each, using sprites, referer checking and serving simple versions of the page to digg users etc. |
Compression helps saving bandwidth, but you'll have to make sure a compressed version is statically available, because compressing the response on-the-fly puts more strain on the server.
| krt wrote: | | Quote: | | If one page results in, say, 12 more requests, this is exponentially increasing the effect of Digg visits. |
Exponentially? Are you sure? |
No, it's linear. But it matters a lot. 
_________________
Captain Jell-O Buster from the Future
[img]http://feeds.feedburner.com/sparepencil.1.gif[/img] |
|
| Back to top |
|
| |
Rashy
Lifeless Person
Joined: 25 Sep 2006
Posts: 632
|
| Posted: Sun Sep 16, 2007 6:51 pm Post subject: |
|
|
Alright. I'm not as confident as my sponsor about hitting a front page digg, but I will go ahead and get some caching features in place. Having something like WP-Cache won't effect statistics like Analytics or AWStats would it?
_________________
Rashy! |
|
| Back to top |
|
| |
ClickFanatic
Est. 2005
Joined: 18 Jan 2005
Posts: 3857
|
| Posted: Mon Sep 17, 2007 7:40 am Post subject: |
|
|
| Rashy wrote: | | Alright. I'm not as confident as my sponsor about hitting a front page digg, but I will go ahead and get some caching features in place. Having something like WP-Cache won't effect statistics like Analytics or AWStats would it? |
Awstats measures requests, so that should continue working properly. Google Analytics uses a script or something. So as long as that is included on your static (cached) pages it should be fine.
WP-Cache does load PHP, though. It reduces the load, but the parser is loaded into memory for each request. This is less effective than a true static file, but I guess it helps a lot.
_________________
Captain Jell-O Buster from the Future
[img]http://feeds.feedburner.com/sparepencil.1.gif[/img] |
|
| Back to top |
|
| |
Voldemort
Unhandled Exception
Joined: 27 Apr 2005
Posts: 948
Location: In a Galaxy far, far away
|
| Posted: Mon Sep 17, 2007 8:01 am Post subject: |
|
|
A thing I know for sure is that the server cannot withstand a digged IPB page. Tested first hand. 
Better cache it completely instead of using script cache features. If it's a script page (like wordpress, a forum or anything else), I would suggest to convert it completely to an .html file, so as to have peace of mind. 
_________________
It's beginning to look a lot like Christmas
Everywhere you go;
Take a look in the five and ten glistening once again
With candy canes and silver lanes aglow..
(It's beginning to look a lot like Christmas) |
|
| Back to top |
|
| |
Rashy
Lifeless Person
Joined: 25 Sep 2006
Posts: 632
|
| Posted: Mon Sep 17, 2007 2:23 pm Post subject: |
|
|
Well I can't create a static .html file for every one of my articles (at least I don't think I can).
I suppose I would just have to keep an eye on my dugg articles to make sure that they don't get out of hand and if they do prep a .html real fast. I think I saw an article on how to do this (and I think it front-paged on digg too )
_________________
Rashy! |
|
| Back to top |
|
| |
ClickFanatic
Est. 2005
Joined: 18 Jan 2005
Posts: 3857
|
|
| Back to top |
|
| |
krt
...
Joined: 11 Jan 2005
Posts: 4607
Location: Australia
|
| Posted: Mon Sep 17, 2007 7:40 pm Post subject: |
|
|
| Why? Won't you just exhaust your bandwidth and have your site shut down automatically with a message somewhere along the lines of "Site is temporarily unavailable: Bandwidth Exceeded" |
|
| Back to top |
|
| |
Voldemort
Unhandled Exception
Joined: 27 Apr 2005
Posts: 948
Location: In a Galaxy far, far away
|
| Posted: Tue Sep 18, 2007 3:10 am Post subject: |
|
|
| krt wrote: | | Why? Won't you just exhaust your bandwidth and have your site shut down automatically with a message somewhere along the lines of "Site is temporarily unavailable: Bandwidth Exceeded" |
Nope. Mine had lots of bandwidth left even after the whole digg frontpage thing was over. Digg effect has to do much more with server resources, like PHP, mySQL and the like, rather than bandwidth consumption.
_________________
It's beginning to look a lot like Christmas
Everywhere you go;
Take a look in the five and ten glistening once again
With candy canes and silver lanes aglow..
(It's beginning to look a lot like Christmas) |
|
| Back to top |
|
| |
spock
iSpock
Joined: 23 Mar 2005
Posts: 2866
Location: The Netherlands
|
| Posted: Tue Sep 18, 2007 9:41 am Post subject: |
|
|
| ClickFanatic wrote: | | A static HTML page is much better, as it requires (close to) zero pre-processing. |
Exactly, if you get dugg/might get dugg, put a static copy of your page somewhere.
_________________
Spock's blog
My new site
My OpenTTD data package |
|
| Back to top |
|
| |
ClickFanatic
Est. 2005
Joined: 18 Jan 2005
Posts: 3857
|
| Posted: Tue Sep 18, 2007 9:42 am Post subject: |
|
|
| krt wrote: | | Why? Won't you just exhaust your bandwidth and have your site shut down automatically with a message somewhere along the lines of "Site is temporarily unavailable: Bandwidth Exceeded" |
It's not about bandwidth. The large amount of requests create a sudden increase in CPU and memory usage, which hangs the server (making all hosted sites unavailable).
_________________
Captain Jell-O Buster from the Future
[img]http://feeds.feedburner.com/sparepencil.1.gif[/img] |
|
| Back to top |
|
| |
|
|
|
Forum FAQs 
Knowledge Base 
Memberlist 
Usergroups 
Hosting
Register
Donate 
Profile 
Log in 
