View Post [edit]
Poster: | James Day | Date: | Apr 1, 2005 6:47pm |
Forum: | petabox | Subject: | Re: about 400TB of this design shipped to the Archive |
In practice, Wikipedia sees closer to 20-40 megabytes per second over local gigabit links. Probably not coincidentally, typical router traffic levels in colocation sites tend to have about a 340 megabits per second traffic limit in practical use.
Can definitely see why the Internet Archive wants a faster network connection. Gigabit switches are inexpensive compared to the costs they reduce. Notably getting things done within easy human attentions span or getting a system working again after a problem.
Trying to maintain a high traffic, high availability place can significantly change views of what is optional and what is necessary. Things like power distribution units with meters and alarms so someone is less likely to take out a whole rack or site by overloading a 30 amp circuit. You haven't lived until something avoidable like that has taken a popular site down for half a day because you didn't spend (or didn't have available to spend) $350 or so for a metered PDU and your colo wasn't watching.
Brak's earlier comment about costs was also spot on. There's a lot more to factor in than the obvious bits when you have to be reliable and need to price the whole system.
Reply [edit]
Poster: | indianews | Date: | Jan 21, 2010 7:27am |
Forum: | petabox | Subject: | Re: about 400TB of this design shipped to the Archive |
Reply [edit]
Poster: | dunno | Date: | Jun 11, 2005 7:45am |
Forum: | petabox | Subject: | Re: about 400TB of this design shipped to the Archive |
now, I suppose you were locked in to a micro-ITX board because of your custom case, but I am under the impression that socket 370, and socket 479 (P3, and Banias/dothan) boards are available for that format. perhaps they were more expensive (the banias/dothan boards), or not available with gigabit (P3?).
anyway, I can't imagine it would be easy to run a P4 2.8 in a 1U rack, much less 40 in a 42 rack, and I would imagine it would drastically increase the HVAC burden, and the kW/hr.
Reply [edit]
Poster: | James Day | Date: | Jun 11, 2005 12:27pm |
Forum: | petabox | Subject: | Re: about 400TB of this design shipped to the Archive |
On the Wikipedia side, we've recently started storying three identical copies of our old versions of article text on our P4 Apache web servers/page builders, to use their hard drives for something useful. The Petabox might have some similar processing power need or might just not have been able to get what they wanted in the available alternative options. Wikipedia hasn'yet given much thought ot kW/hr and HVAC loads, perhaps mostlybecause they are just part of the package at our current hosting place.