Categories
Internet

90% Of Web Traffic Is Video

There’s a lot of talk about the prediction from YouTube’s Robert Kyncl that video will be 90% of internet traffic. This sounds shocking until you realize it’s not, and doesn’t really mean much in context of the internet.

This number presumably is at least partially based on a prediction by Cisco who makes routers that carry that internet traffic. They even bought Flip (an unfortunate tale) simply to help drive video on the internet and presumably drive up the need for routers, their main business. They might have a bias.

The reality is video already is, and will continue to be the vast majority of Internet traffic. However that doesn’t mean people are spending as much time on it as the numbers will make you believe. Video per minute of online activity is just insanely high bandwidth and expensive. The percentage of bandwidth is meaningless, what matters is where people spend their time.

Video compresses very poorly in comparison to text and audio (interestingly, speech compresses fairly well these days). Video these days either streaming or progressive download is still a very bandwidth intensive activity.

This webpage is likely under 160 KB for you and loads in about 300 ms. You’ll spend statistically a few minutes reading this, perhaps slightly less if you just skim for the numbers. The takeaway is experiencing: this blog post is about 160 KB over a few minutes assuming you visit the site, and don’t use an RSS reader (go ahead RSS users, try it).

Now lets figure out what video is typically. Most web video these days is still H.264, and generally 640×480 (480p) or 1280×720 (720p). Most laptops today are pretty cheap and just can’t handle 1080p, certainly their displays aren’t good enough to show a measurable difference, not to mention the buffering time annoys people, so we’ll ignore it’s existence.

I want to make this a little realistic, so to figure out a bitrate, we’ll use the standard formula for what Adobe calls ‘ideal’ in the H.264 Primer, and what most seem to use these days:

[image width] x [image height] x [framerate] x [motion rank] x 0.07 = [desired bitrate]

For 1280×720 that means:

1280 x 720 x 24 x 2 x 0.07 = 3,096,576 bps = ~3000 kbps

And for 640×480:

640 x 480 x 24 x 2 x 0.07 = 1,032,192 bps = ~1000 kbps

This sounds about right. As of today, Wikipedia lists the bandwidth range for 720p at 2–2.9 Mbit/sec and for 480p at 0.8–1 Mbit/sec. So we know we’re on track.

That’s all the math we really need to do. Google can do the conversions for us:

For 720p:

3000 kbps = 1,318.35938 Megabytes / hour = 22 MB / min

For 480p:

1000 kbps = 439.453125 Megabytes / hour  = 7.3 MB / min

Going back to the example of this blog permalink, at 160 KB for a few minutes of reading vs. 7,475 KB for one minute of 480p video. That is why video is 90% of traffic.

Video growth is huge, but it’s not nearly as one sided as the stats will lead you to believe.

Categories
Internet

W3C On DTD Perversions

According to the W3C Systeam’s blog, there’s a lot of poorly designed software out there. It’s pretty rare that something has a legitimate need to pull down a DTD in order to work. They should never be requesting it on a very frequent basis. It’s a very cachable asset. The post includes some pretty impressive stats too:

..up to 130 million requests per day, with periods of sustained bandwidth usage of 350Mbps, for resources that haven’t changed in years.

They also make a few requests which really all developers should follow. Here’s my summary:

  • Cache as much as possible, to minimize your impact on others (not to mention improve your performance).
  • Respect caching headers
  • Don’t fetch what you don’t need
  • Identify yourself. Don’t use a generic UA.
  • Try not to suck.
Categories
Networking

Upload Bandwidth

I’ve moaned before about the lack of good upload bandwidth despite having rather decent download speeds. Comcast’s new PowerBoost for upload took effect this week, giving a burst of about 1Mbps for uploads for the first part. While this doesn’t quite fix the problem with making remote backups, it does help in some cases.

Hopefully DOCSIS 3.0 or FIOS will come around.

Categories
Internet Networking

Early Morning Bandwidth

It’s well known cable modems are “shared bandwidth”, meaning if everyone on your neighborhood is downloading Paris Hiltons latest video off the net (ahem… her music video), your connection slows down. Well Comcast’s feature for the past several month allows you to briefly use the excess bandwidth when it’s quiet. So what does it look like at 1:30 AM?

Bandwidth

During peak hours it’s really not that much worse. Typically between 7000kbps – 14000kbps. Not to bad. Of course Verizon will eventually roll out 15Mbps sustained with 2Mbps upstream. Comcast just announced “speedburst” for upstream, and it doesn’t really compare to Verizon’s Fiber offering. DOCSIS 3.0 can’t come quick enough.

Take that 56k dialup!

Categories
Internet Networking

Pathetic Speed Part II

Decided to run a speedtest in the lab today, to compare with my test from the other day. I know they limit the dorms a bit. But boy was I suprised to see this:

8400kbps Down 3140kbps Up

That’s insane.

Categories
Internet Networking

Pathetic Speed

159kbps down/86kbps up

Most people think I’m joking when I say my school has absolutely pathetic bandwidth. Yes, that’s the result of the best of several speed tests. You don’t get much more sorry than that. And sadly, it gets much worse around finals week as everyone goes online at the same time.

Categories
Networking

Grub, a Network Admin’s Greatest Nightmare

Yikes, just got a chance to try out Grub, a distributed web crawling project… aka cheap bandwidth… This thing is scary. If I were a Network Admin, I would be working on ways to block this right now. This thing is bad news.