Categories
The Industry

Cable Companies Tout Speed Increases

Earlier this month, NCTA – The Internet and Television Association – posted an article on its website touting the big increases in broadband speeds since the start of the pandemic. NCTA is the industry trade and lobbying association for medium-sized and large cable companies.

The article touts that the average U.S. download speed has grown from 138 Mbps in March 2020, the first month of the pandemic, to 226 Mbps in June 2022. These speeds come from the Ookla Speedtest Global Index. The cited numbers are the mean, or the average speeds measured by Ookla in the respective months across the whole U.S. Obviously, the cable companies are taking credit for much of the speed increase, and to some extent, that’s true. But there are a number of different reasons why average download speeds are increasing.

One of the primary reasons is directly related to the cable companies. Over the last year, cable companies have almost universally increased the download speed of the base broadband product to 200 Mbps to 300 Mbps. This not only applies to new customers, but many existing customers woke up one day in the last year with a download speed increase. This is something that the cable companies had done periodically since the days when speeds were 6 Mbps download. Since Comcast and Charter alone serve over half of all broadband customers in the country, anything the big cable companies do to increase speeds affects a lot of people and drives up the national average speed.

Another factor that is driving up average speeds is more homes getting access to fiber. This is starting to rachet up and many homes are now seeing a second fast choice other than the cable company. When looking at the amount of fiber being built and the sales goals of the fiber companies, this is going to be picking up in the coming years. To some extent, the big cable companies are also building fiber. Charter, in particular, is building fiber on the fringe of its traditional cable markets to new subdivisions or areas where the company has gotten grants. I’ve been hearing from Charter cable customers lately who are frustrated that the company is building fiber nearby and not in their neighborhood.

One of the major reasons for the average speed increases reflects poorly on the cable companies. Over the last two years, there has been a huge migration of homes buying faster broadband packages. These are homes that struggled with broadband performance and upgraded to get better speeds. Most people didn’t realize (and still may not realize) that their issues during the pandemic were mostly due to poor upload bandwidth from the cable companies. Folks upgraded to faster download packages hoping to get better upload performance, and even after the upgrade, many did not. You’ll notice on the NCTA website that there is no mention of upload bandwidth – a topic the cable companies absolutely do not want to discuss.

A final factor that is contributing to a faster national average download speed is the rapid expansion of fiber in rural areas. While this doesn’t represent a big slice of people, the national average speeds are boosted when households migrate from download speeds of 1 or 2 Mbps to fast download speeds on fiber. There is currently a lot of construction going on funded by the FCC’s ACAM program, federal grants and subsidies like ReConnect and RDOF, and numerous state broadband grants.

So yes, the cable companies deserve credit for increasing download speeds – and they are a big part of the reason behind the faster national average speeds. But it’s not all due to the cable companies.

Categories
Regulation - What is it Good For? The Industry

Grants and Upload Speeds

The NTIA set a new definition of broadband at 100/20 Mbps for purposes of the BEAD grants – if a customer fails that test they are considered either unserved or underserved. Everybody nationwide has been so focused on download speeds that we are largely ignoring the fact that a huge number of nationwide broadband customers are not getting upload speeds of 20 Mbps. All of the speed test efforts I’ve seen have focused on whether homes and businesses are receiving 100 Mbps download and have largely ignored any implications of customers not achieving the NTIA’s 20 Mbps upload stream to qualify for a broadband grant.

My consulting firm helps clients conduct a lot of speed tests, and I also have been poring through the large number of speed tests gathered by Ookla and MLabs. I mostly work in rural counties, county seats, and suburban cities. I would venture to say that the vast majority of speed tests we see from cable customers do not meet the upload speed. The same is true for a large percentage of WISPs.

Sometimes the evidence is overwhelming. I recently worked with a county seat of about 20,000 people and the only customer in the community seeing upload speeds of 20 Mbps or faster were those who subscribed to the cable company’s gigabit product. Not one other cable customer had a 20 Mbps, and most weren’t even close, with an average of 11 Mbps. This was true for customers buying both a 100 Mbps, 200 Mbps, and 400 Mbps download product.

This raises an interesting question, which I’m sure is going to be the core of the cable company’s response to this question. In that particular city, the gigabit customers were getting upload speeds between 30 Mbps and 40 Mbps. I’m sure the cable company will argue that since a few customers are getting speeds over 20 Mbps that the network is capable of faster speeds.

I’ve talked to several knowledgeable engineers on the topic, and they tell me that the cable company in this case could not give faster speeds to everybody – or they would. The cable company is somehow giving a preference for gigabit customers at the expense of everybody else. If the cable operator opened the gates for everybody to get the fastest upload speed possible, the likely outcome would be that the gigabit customer speeds would drop to match everybody else’s speeds – the other customers would not get any faster.

This is an interesting question for state broadband grant offices to consider because it’s inevitable that people are going to seek grants where there is a cable company operating, using the argument that the cable company doesn’t meet the NTIA’s definition of broadband.

It makes sense to me that an ISP must meet both components of the speed definition to be considered as served. It shouldn’t matter if an ISP misses on the download or upload speed – if it fails one of the two benchmarks, it is not meeting the NTIA’s definition of served. If you don’t believe that logic, consider an ISP that is delivering 50/20 Mbps on licensed fixed wireless. I think there would be a consensus that this customer is not served since it is achieving only half of the definition of download speeds. But isn’t the same true for an ISP that is delivering 120/10 Mbps broadband?

To be fair to cable companies, they deliver speeds greater than 20 Mbps in many markets. I buy 400 Mbps download from Charter and routinely see upload speeds of 30 Mbps. But we all know that the performance of cable companies varies widely from town to town, and often inside of a town.

I had to laugh last year when the big cable companies fought so hard to reduce the definition of served from 100/100 Mbps to 100/20 Mbps. I knew then that this battle would be coming since the majority of cable customers, at least in the markets I have studied, are not seeing upload speeds of 20 Mbps.

One thing I think we can all count on is that if any grant office awards funding to overbuild a cable company because of this issue, we’re going to see the cable industry go ape. They’ve been quiet about the poor upload speeds, but they won’t stay that way if they see grant money coming to overbuild them.

Categories
The Industry

What We’ve Learned About Upload Bandwidth

Until the pandemic hit, I rarely thought about upload bandwidth. I mostly used upload bandwidth to send files to people, and I rarely cared if they received the files immediately – I was happy as long as files got sent. But the pandemic changed everything for millions of people. All of a sudden, homes were unable to function well due to problems with uploading.

The big change from the pandemic came when many millions of people were sent home to work while students were sent home to attend school remotely. It turns out that connecting to schools and offices requires steady and reliable upload bandwidth, and many homes found they didn’t have that. My consulting firm has done several surveys per month during the pandemic, and we routinely have seen that at least 30% of those working or schooling from home, including those using cable company broadband, say that their bandwidth was not adequate for the needs created by the pandemic. Homes that tried to accommodate multiple people working online at the same time had the worst experiences.

We also changed a lot of other behavior during the pandemic that uses more upload bandwidth. Many who work from home started using software that automatically saves all work in the cloud. We started using collaborative software to connect to others working from home. And we began making Zoom calls to such an extent that this is now the largest use of upload broadband nationwide and has grown from practically nothing to consume over 15% of all upload broadband usage. Spending more time at home led millions to take up gaming – an activity that just started transitioning to the cloud before the pandemic.

We also got a stark reminder that broadband technologies are shared services. We saw that even homes with only one person working at home could suffer if the bandwidth for the whole neighborhood got bogged down from overuse.

It seems that everybody started collecting speed tests to figure out what was going wrong. Local governments, States, and the NTIA started gathering and looking at speed test results. We know that an individual speed test result is not reliable, but we’ve seen that masses of speed tests tell a great story about a given ISP in a given community.

We also learned that broadband networks vary by neighborhood – something that I don’t recall ever being discussed before the pandemic. Speed tests often showed that the performance of a cable company in a city could be drastically different by neighborhood. There have always been those who complained about cable company broadband, but they weren’t taken seriously by those in the same town that had adequate broadband. But we now often see some parts of cities with speeds drastically lower than the rest of the city – something cable companies have known about but never fixed.

We learned how awful rural broadband technologies can be when most rural folks had problems working and schooling from home. We figured this out when speed tests showed that rural upload speeds are often less than 1 Mbps.

Lately, I’ve been learning more about jitter, which measures the variance in broadband signal strength. Many people learned about jitter the hard way when they often got booted from school connections or Zoom calls when broadband signal strength fluctuated and hit a low point.

We also learned how the cable companies use the worst spectrum on a cable system to transmit upload speeds. They use spectrum inside the coaxial cables to transmit data, and the portion of the network used for upload is where natural interference from microwave ovens, small engines, and natural background radiation causes the most interference.

We’ve also learned that the pandemic has been good for the ISPs, although they aren’t talking about it. Millions of homes upgraded to faster broadband to try to get enough bandwidth during the pandemic. Unfortunately for many of them, their problem was not the download speeds, but the upload speeds, and the upgrade may not have brought much of a solution.

Categories
Regulation - What is it Good For? The Industry

The Upload Speed Lie

In the 2020 Broadband Deployment Report, the FCC made the following claim. “The vast majority of Americans – surpassing 85% – now have access to fixed terrestrial broadband service at 250/25 Mbps”. The FCC makes this claim based upon the data provided to it by the country’s ISPs on Form 477. We know the data reported by the ISPs is badly flawed in the over-reporting of download speeds, but we’ve paid little attention to the second number the FCC cites – the 25 Mbps upload speeds that are supposedly available to everybody. I think the FCC claim that 85% of homes have access to 25 Mbps upload speeds is massively overstated.

The vast majority of the customers covered by the FCC statement are served by cable companies using hybrid fiber-coaxial technology. I don’t believe that cable companies are widely delivering upload speeds greater than 25 Mbps upload. I think the FCC has the story partly right. I think cable companies tell customers that the broadband products they buy have upload speeds of 25 Mbps, and the cable company’s largely report these marketing speeds on Form 477.

But do cable companies really deliver 25 Mbps upload speeds? One of the services my consulting firm provides is helping communities conduct speed tests. We’ve done speed tests in cities recently where only a tiny fraction of customers measured upload speeds greater than 25 Mbps on a cable HFC network.

It’s fairly easy to understand the upload speed capacity of a cable system. The first thing to understand is the upload capacity based upon the way the technology is deployed. Most cable systems deploy upload broadband using the frequencies on the cable system between 5 MHz and 42 MHz. This is a relatively small amount of bandwidth that sits at the noisiest part of cable TV frequency. I remember back to the days of analog broadcast TV and analog cable systems when somebody running a blender or a microwave would disrupt the signals on channels 2 through 5 – the cable companies are now using these same frequencies for uploading broadband. The DOCSIS 3.0 specification assigned upload broadband to the worst part of the spectrum because before the pandemic almost nobody cared about upload broadband speeds.

The second factor affecting upload speeds is the nature of the upload requests from customers. Before the pandemic, the upload link was mostly used to send out attachments to emails or backup data on a computer into the cloud. These are largely temporary uses of the upload link and are also considered non-critical – it didn’t matter to most folks if a file was uploaded in ten seconds or five minutes. However, during the pandemic, all of the new uses for uploading require a steady and dedicated upload data stream. People now are using the upload link to connect to school servers, to connect to work servers, to take college classes online, and to sit on video call services like Zoom. These are critical applications – if the upload broadband is not steady and sufficient the user loses the connection. The new upload applications can’t tolerate best effort – a connection to a school server either works or it doesn’t.

The final big factor that affects the bandwidth on a cable network is demand. Before the pandemic, a user had a better chance than today of hitting 25 Mbps upload because they might have been one of a few people trying to upload at any given time. But today a lot of homes are trying to make upload connections at the same time. This matters because a cable system shares bandwidth both in the home, but also in the neighborhood.

The upload link from a home can get overloaded if more than one person tries to connect to the upload link at the same time. Homes with a poor upload connection will find that a second or a third user cannot establish a connection. The same thing happens at the neighborhood level – if too many homes in a given neighborhood are trying to connect to upload links, then the bandwidth for the whole neighborhood becomes overloaded and starts to fail. Remember a decade ago that it was common for downloaded videos streams to freeze or pixelate in the evening when a lot of homes were using broadband? The cable companies have largely solved the download problem, but now we’re seeing neighborhoods overloading on upload speeds. This results in people unable to establish a connection to a work server or being booted off a Zoom call.

The net result of the overloaded upload links is that the cable companies cannot deliver 25 Mbps to most homes during the times when people are busy on the upload links. The cable companies have ways to fix this – but most fixes mean expensive upgrades. I bet that the cable companies are hoping this problem will magically go away at the end of the pandemic. But I’m guessing that people are going to continue to use upload speeds at levels far higher than before the pandemic. Meanwhile, if the cable companies were being honest, they would not be reporting 25 Mbps upload speeds to the FCC. (Just typing that made me chuckle because it’s not going to happen.)

Categories
Regulation - What is it Good For?

FCC – Please Focus on Upload Speeds

I wrote a recent blog that talked about how the FCC is recommending to stick with the 25/3 Mbps definition of broadband for another year. In that blog, I mostly talked about how 25 Mbps download is out of touch when the FCC claims that 85% of homes today can buy 250/25 Mbps broadband.

Today I want to look at the second half of the definition – the upload speed. The FCC is proposing, in 2020 – the year when millions were sent home for work and school – that 3 Mbps upload is a sufficiently high definition of broadband. Sticking with the 3 Mbps definition of broadband makes no sense. I contend that 3 Mbps is massively out of touch with the needs of the average home. To make matters worse, the FCC will allow an ISP that offers 25/3 broadband to bid in and win grant funding in October’s RDOF grant – a network which the ISP then has six years to build. The FCC doesn’t just think that 25/3 is adequate broadband today, they think that is okay broadband size years from now.

The pandemic has made it clear to a lot of households that upload speeds matter. Before the pandemic, customers that cared about the upload speeds tended to be folks that sent huge files such as doctors, architects, engineers, photographers, etc. When they worked from home these folks have known for years that the upload speeds on the average home network are inadequate.

All of a sudden this year, millions of homes found out that they don’t have enough upload broadband speeds. Consider the amount of bandwidth that is needed to work from home. There are two uses of upload broadband that are new to most people – connecting to a school or work server and participating in Zoom or other online meetings.

Many home and work servers require the creation of a virtual private network (VPN). A VPN is a dedicated connection – the home connects and stays connected to a school or work server. It generally requires dedicating at least 1 Mbps of bandwidth, but usually more, to create and maintain a VPN connection. This means that somebody working at home on a VPN is going to tie up 1 – 3 Mbps of bandwidth that can’t be used for anybody else in the home.

Zoom calls also require upload bandwidth. The Zoom website says that a home should have a 2 Mbps connection, both upload and download to sustain a Zoom session between just two people. The amount of download bandwidth increases with each person connected to the call, meaning Zoom recommends the 2 Mbps upload, but a 6 Mbps download for a meeting with three other people.

There are other uses for upload bandwidth in the home as well. For example, a telemedicine call can use even slightly more bandwidth than connecting to work or school servers. Upload bandwidth is needed for gaming in the cloud. Upload bandwidth is also used to back-up data files, pictures, etc. into the cloud.

It doesn’t take complicated math to see why a 3 Mbps connection is inadequate for any household that wants to make more than one upload-heavy connection to the Internet at the same time. 3 Mbps is not enough bandwidth for multiple people in a home trying to connect to work and school servers or to make Zoom-like calls. I’ve heard from numerous people this year telling me they can’t have more than one person at a time using their home broadband connection. Many of these complaints came from households using broadband provided by the big cable companies, and many of these homes thought they had plenty of bandwidth until the pandemic hit.

For the FCC to stick with 3 Mbps upload as the definition of broadband is a slap in the face to every family where more than one person wants to connect to the web at the same time. With that definition, the FCC is blessing any ISP that delivers 3 Mbps upload speeds.

Even if the FCC doesn’t want to upgrade the download component of the definition of broadband, they can’t turn a blind idea to the millions of homes trying to make it through the pandemic. If social scientists are right, there will likely be millions of people who continue to work remotely even after the end of the pandemic. This is not a temporary problem that is somehow going to go away.

It’s hard to think that the minimum acceptable definition of upload speeds should be anything slower than 25 Mbps. Assuming a robust WiFi network, that’s enough bandwidth for 3 – 4 adults and/or students to work from home at the time. So FCC, please reconsider the definition of upload speeds. If you stick with 3 Mbps upload as the definition of broadband it means you don’t support broadband networks that can deliver the speeds that the average households need.

Categories
The Industry

Can 5G Compete with Cable Broadband?

One of the recurring themes used to promote 5G is that wireless broadband is going to become a serious competitor to wireline broadband. There are two primary types of broadband competition – competition by price or performance. Cable companies have largely won the broadband battle in cities and suburbs and I’ve been thinking about the competition that cable companies might see from 5G.

Cable broadband is an interesting product. In most cities and suburbs today, the basic broadband product has a download speed between 100 Mbps to 200 Mbps with upload speeds in the range of 10 Mbps to 15 Mbps. The cable companies decided over a decade ago that they were going to stay in front of market demand and have periodically increased speeds, with the most recent speed increases introduced around two years ago. Cable systems can offer speeds up to a gigabit, but the ugly secret that cable companies don’t want to talk about is that it would be incredibly expensive if too many people bought and used gigabit speeds. CCG does market surveys and the primary complaints that customers have about urban cable broadband is inconsistency – networks have periodic slowdowns and outages that customers find frustrating. As much as one third of cable customers also poll as hating the customer service of the larger cable companies.

The biggest weakness of cable broadband is the upload speed. This wasn’t an issue for most homes until the recent pandemic sent students and parents home. Many homes that were satisfied with cable broadband have found that the upload streams are inadequate to allow multiple people in a home to connect to servers and video conferencing services. Cable companies can probably tweak upload speeds upward by 50% more, but that will still feel slow to many homes. Cable companies are faced with an expensive upload to DOCSIS 4.0 to create symmetrical speeds.

There are two products being marketed as 5G. The first is Verizon’s fixed wireless access product. This is not 5G and is best described as fiber-to-the-curb, because it requires a fiber network built close to homes to provide this product. This is a fiber technology that happens to use a wireless drop. As such, it is technologically superior to cable broadband in that speeds can be symmetrical. Verizon says speeds can be as fast as a gigabit, but speeds will vary by customer and will likely slow down during heavy rain or get slower in summer when shrubs and trees are in full leaf. From a price perspective, Verizon is using this product to reduce cellular churn and is pricing it at $50 for a Verizon wireless customer and $70 for everybody else.  The $70 price is not going to push Comcast and Charter to lower prices, but it might force them to hesitate with future rate increases for neighborhoods that are competing with the Verizon product.

The FCC and the industry have implied for years that 5G cellular will be a competitor for landline broadband. I still can’t see many homes accepting 5G cellular as a replacement for landline broadband. I can think of a number of important ways to compare and contrast the two broadband products:

Speed. Forget the millimeter-wave product that cellular companies are touting as delivering cellular speeds over a gigabit. It’s a gimmick product used  to try to promote the idea that 5G is fast. The millimeter-wave technology is only good outdoors, and even then only travels a few hundred feet from a cell site. It delivers gigabit speeds to cellphones – when cellphones aren’t designed to run multiple apps that require fast broadband. The 5G download speeds on regular cellphones should creep up 100 Mbps over the next 5 to 7 years, and would rival the base speeds on cable company networks – but by that time the cable companies are likely to upgrade all of their customers to 250 Mbps. Cellular upload speeds don’t matter, because no family is going to conduct multiple upload sessions over a single cellphone.

Overall Capacity. Cellular networks today carry less than 5% of all US broadband. Even the majority of data passed through cellphones is handed off to landline networks through WiFi. In North America this year, Cisco predicts that in 2020 there will be 77 exabytes per month carried by landline networks compared to 3.4 exabytes carried by cellular networks. By 2022 that will grow to 109 exabytes for landline networks and 6 exabytes for cellular networks – the gap between the two technologies is rapidly widening. There is no scenario where cellular networks can somehow steal away a lot of the traffic carried by landlines. When cellular companies make this claim they are arguing against the realities of physics.

Household Usage. Household usage of broadband has exploded. In the first quarter of 2018, the average US home used 215 gigabytes of data per month. At the end of the recent first quarter of 2020 that had grown to over 400 gigabytes per month. By 2024 the average home might be using more than 700 gigabytes per month.

Data Caps. The above statistics show the absurdity of the claim that cellular will somehow overtake landline broadband. Even the ‘unlimited’ cellular data plans today are capped or heavily throttled after 20 or so gigabytes of data used in a month. Cellular companies are not likely to raise the data caps much because they don’t want heavy data users sucking all of the capacity out of the cellular networks.

Pricing. US cellular data is the most expensive broadband in developed countries. For 5G to compete with landline broadband, the cellular companies would have to kill the paradigm of selling an extra gigabyte of data for $10. 5G can only compete with landline broadband if the cellular carriers can increase wireless network capacity by a factor of ten and are willing to lower prices by more than a factor of ten. The first is not possible due to the limitations of physics and there are no indications that cellular carriers are willing to consider the second.

Categories
The Industry

How Will Cable Companies Cope with COVID-19?

A majority of households today buy broadband from cable companies that operate hybrid coaxial fiber networks (HFC) that us some version of DOCISIS technology to control the networks. The largest cable companies have upgraded most of their networks to DOCSIS 3.1 that allows for gigabit download speeds.

The biggest weakness in the cable networks is the upload data links. The DOCSIS standard limits the upload path to me no larger than 1/8th of the total bandwidth uses – but it’s not unusual for the cable companies to make this path even smaller and offer products like 100/10 Mbps where the upload is 1/11th of the total bandwidth provided to customers.

This is not a new concern for the cable companies and the engineering folks at Comcast and other big cable companies have been discussing ways to improve upload bandwidth for much of the last decade. They understood that the need for uploading would someday overwhelm the bandwidth path provided – they just didn’t expect to get there so explosively as been done in reaction to the COVID-19 crisis.

Every student and employee trying to work from home is carving out an uploaded VPN when they connect to a school or work server. Customers are also using significant upload bandwidth when they join a video call on Zoom or other platforms. While carriers report 30–40% overall increases in traffic due to COVID-19, they are not disclosing that a lot of that increase is demand for uploading.

Cable companies are now faced with solving the upload crisis. Practically every prognosticator in the country is predicting that we’re not going to return to pre-COVID behavior. There is likely to be a lot of people who will continue to work from home. While students will return to the classroom eventually, this grand experiment has shown that’s it’s feasible to involve students in the classroom remotely, and so school systems are likely to continue this practice for students with long-term illnesses or other reasons why they can’t always be in the classroom. Finally, we’ve taught a whole generation of people that video meetings can work, so there is going to be a whole lot more of that. The day of traveling to attend a few hour meeting might be over.

There is one other interesting fact to consider when looking at a cable company upload data path. Cable companies have generally devalued the upload path quality and have assigned the upload path to the low frequencies on the cable network spectrum. Historically upload data speeds were provisioned on the 5-42 MHz range of spectrum. This is the spectrum in a cable system that experiences the most interference from things like microwave ovens, vacuum cleaners and passing large trucks. Cable companies could get away with this because historically most people didn’t care if it took longer to upload a file or if packets had to be retransmitted due to interference. But people connecting to WANs and video conferences care about the upload quality as well as speed.

One solution, and something that some cable providers have already done is to do what is called a mid-split upgrade that extend the spectrum for uploading to the 5-85 MHz band. This still includes a patch of the worst spectrum inside the cable system, but is a significant boost in the amount of upload broadband available. Depending upon the settop boxes being used, this upgrade can require some new customer boxes.

Another idea is to do more traditional node splits, meaning to reduce the number of customers included in a neighborhood node. Traditionally, node splits were done to improve the performance of download speeds – this was the fastest way to relieve network congestion when a local neighborhood network bogged down unduly in the evening. It’s an interesting idea to consider splitting nodes to relive pressure on the upload data path.

After those two idea the upgrades get expensive. Migrating to switched digital video could free up a mountain of system bandwidth which would allow for a larger data path, including an enlarged upload path. The downside of this kind of upgrade is that it moves outside of the DOCSIS technology and starts to look more like providing Ethernet over fiber. This is not just a forklift upgrade it changes the basic way the network operates.

The final way to get more upload speed would be an upgrade to the upcoming DOCSIS 4.0 standard. Everything I read about this makes it sound expensive. But the new standard would allow for nearly symmetrical data services and would let cable network broadband compete head-on with fiber network. It will be interesting to see if the cable companies view the upload crisis as bad enough to warrant spending huge amounts of money to fix the problem.

Categories
Current News

The Upload Crisis

Carriers continue to report on the impact of COVID-19 on their networks. One of the more interesting statistics that caught my eye was when Comcast reported that upload traffic on their network was up 33% since March 1. Comcast joins the rest of big ISPs in saying that their networks are handling the increased traffic volumes.

By ‘handling’ the volumes they mean that their networks are not crashing and shutting down. But I think there is a whole lot more to these headlines than what they are telling the public.

I want to start with an anecdote. I was talking to a client who is working at home along with her husband and two teenagers. The two adults are trying to work from home and the two kids are supposed to be online keeping up with schoolwork. Each of them needs to create a VPN to connect to their office or school servers. They are also each supposed to be connecting to Zoom or other online services for various meetings, webinars, or classes.

These functions all rely on using the upload path to the Internet. The family found out early in the crisis that their broadband connection did not provide enough upload speed to create more than one VPN at a time or to join more than one video call. This has made their time working at home into a major hassle because they are being forced to schedule and take turns using the upload link. This is not working well for any of them since the family has to prioritize the most important connections while other family members miss out on expected calls or classes.

The family’s upload connection is a choke point in the network and is seriously limiting their ability to function during the stay-at-home crisis. But the story goes beyond that. We all recall times in the past when home Internet bogged down in the evenings when everybody in the neighborhood was using broadband to watch videos or play games. Such slowdowns occurred when the download data path into the neighborhood didn’t deliver enough bandwidth to satisfy everybody’s request for broadband. When that download path hit maximum usage, everybody in the neighborhood got a degraded broadband connection. When the download path got overloaded, the network responded by giving everybody a little less bandwidth than they were requesting – and that resulted in pixelating video or websites that lose a connection.

The same thing is now happening with the upload links, but the upload path is a lot more susceptible to overload.  For technologies like coaxial cable networks or telephone DSL the upload path leaving the neighborhood is a lot smaller than the download path into the area. As an example, the upload link on a coaxial network is set to be no more than 10% of the total bandwidth allowed for the neighborhood. It takes a lot more usage to overload the download path into the neighborhood since that path is so much larger. On the upload path, the homes are now competing for a much smaller data path.

Consider the difference in the way that homes use the download path compared to the new way we’re all using uploading. On the download side, networks get busy mostly due to streaming video. Services like Netflix stay ahead of demand by downloading content that will be viewed five minutes into the future. By doing so, the neighborhood download network can have cumulative delays of as much as five minutes before the video streams collapse and stop working. The very nature of streaming creates a buffer against failure – sort of a network insurance policy.

Homes are not using the upload links in the same way. Connecting to a school server, a work server, or a video chat service creates a virtual private network (VPN) connection. A VPN connection grabs and dedicates some minimum amount of bandwidth to the user even during times when the person might not be uploading anything. A VPN carves out a small dedicated path through the upload broadband connection provided by the ISP. There is no buffer like there is with downloading of streaming video – when the upload path gets full, there’s no room for anybody else to connect.

The nearest analogy to this situation harkens back to traditional landline telephone service. We all remember times, like after 911, when you couldn’t make a phone call because all of the circuits were busy. That’s what’s happening with the increased use of VPNs. Once the upload path from the neighborhood is full of VPNs, nobody else is going to be able to grab a VPN connection until somebody ‘hangs up’.

Residential customers have historically valued download speeds over upload speeds and ISPs have configured their networks accordingly. Many technologies allow an ISP to balance the upload and download traffic, and ISPs can help upload congestion by providing a little more bandwidth on the upload stream. Unfortunately for cable companies, the current DOCSIS standards don’t allow them to provide more than 10% of bandwidth on the upload side – so their ability to balance is limited.

As I keep hearing these stories from real users I am growing less and less impressed by the big ISPs saying that everything is well and that their networks are handling the increased load. I think there are millions of households struggling due to inadequate upload speeds. It’s true, as the big ISPs are reporting, that the networks are not crashing – but the networks are not providing the connections people want to make. No big ISP is going to admit this to their stockholders – but I bet a lot of those stockholders already understand this first-hand from having troubles trying to work from home.

Categories
Current News

Predictions for a Post-COVID-19 World

While it might still be too early to make predictions, there are dozens of articles on the web predicting how the COVID-19 pandemic might change our long-term behavior. Here are some of the more interesting predictions I’ve seen that involve broadband and telecom:

An Outcry for Better Home Broadband. Millions of people were sent home for work or school to homes that didn’t have good broadband. These folks have been telling the world for years that they don’t have good broadband. When this crisis is over these people are going to insist on being heard, and they are going to take out their anger on politicians who don’t help to find broadband solutions. This means Mayors and City Councils that are not pro-broadband. This means County Boards and Commissions that don’t offer matching grants to attract ISPs. This means any state politician who votes against significant state broadband grants or who votes against municipal participation in broadband. And this means federal Senators and Representatives that support the big cable companies and telcos over their constituents. Folks are not likely to be fooled any longer by false legislation that supposedly is pro-broadband but which is the exact opposite – because folks are going to be paying attention to any news concerning their home broadband.

Digital Meetings Are Here to Stay. We are all seeing how effective it can be to meet online. People are going to be a lot less willing to travel for a one or two-hour meeting. I know my days of doing that kind of traveling are over. This means airline business travel is likely never coming back to former levels, but it means a lot more. I was talking to somebody in local government the other day who told me that they spend over 10 hours of every workweek driving between meetings around a large county. He said he thinks the day or required live attendance at such meetings is likely over.

Demand for Faster Upload Speeds. The permanent uptick in more video meetings means there will be an increased demand for faster upload broadband speeds. The FCC still talks about 25/3 Mbps as acceptable broadband, but a home or office getting only 3 Mbps upload is not able to hold multiple simultaneous video calls. Homes and businesses are going to favor technologies willing to meet that upload speed demand.

Telemedicine has Arrived. I have been watching the glacial acceptance of telemedicine for fifteen years. The biggest hurdles have been the reluctance of doctors to try telemedicine and the willingness of insurance companies to pay for it. We’ve broken both of those barriers and telemedicine is here to stay. There are numerous routine doctor visits that don’t require an office visit. It’s never made sense to force patients who aren’t sick to march through a waiting room that has been filled all day with those with colds, the flu, or worse.

Expect Contactless Payments. I can remember being promised twenty years ago that we’d be able to pay for things by waving a cellphone. Nobody wants to hand a credit card to a clerk or even pass a credit card through a device that other people have used all day – so stores that install touchless payment systems are quickly going to become preferred. Expect an expansion of telephone, voice, and vision interface at checkout locations and a phase-out of credit card swiping. Also, expect an increased reluctance to take cash. There were already stores in New York City last year that made headlines by refusing to accept cash – expect a lot more of that.

More Telecommuting. Businesses have seen that people can be effective when working from home. Expect to see businesses more easily allowing for working from home at least part-time. This likely means a downturn in business real estate. For example, my neighbor is an architect who works at a small local branch of a larger firm. They’ve already seen the effectiveness of working from home and have already discussed not reopening the local office when the crisis is over. More telecommuting means more daytime use of neighborhood bandwidth and an increased expectation of residential broadband signal quality.

A Reboot for Corporate Security. We just spent a decade moving corporate data behind firewalls and restricting access to data from outside the business. Many businesses scrambled to find ways to allow employees to work from home, and in doing so undid many of their security protocols. Expect a major reboot as companies implement security solutions that support telecommuting.

Categories
Technology What Customers Want

The Demand for Upload Speeds

I was recently at a public meeting about broadband in Davis, California and got a good reminder of why upload speeds are as important to a community as download speeds. One of the people making public comments talked about how uploading was essential to his household and how the current broadband products on the market were not sufficient for his family.

This man needed good upload speeds for several reasons. First, he works as a photographer and takes pictures and shoots videos. He says that it takes hours to upload and send raw, uncompressed video to one of his customers and says the experience still feels like the dial-up days. His full-time job is working as a network security consultant for a company that specializes in big data. As such he needs to send and receive large files, and his home upload bandwidth is also inadequate for that – forcing him to go to an office for work that could otherwise be done from his home. Finally, his daughter creates YouTube content and has the same problem uploading content – which is particularly a problem when her content deals with time-sensitive current events and waiting four hours to get the content to YouTube kills the timeliness of her content.

This family is not unusual any more. A decade ago, a photographer led the community effort to get faster broadband in a city I was working with. But he was the only one asking for faster upload speeds and most homes didn’t care about it.

Today a lot of homes need faster upload speeds. This particular family had numerous reasons including working from home, sending large data files and posting original content to the web. But these aren’t the only uses for faster upload speeds. Gamers now need faster upload speeds. Anybody who wants to remotely check their home security cameras cares about upload speeds. And more and more people are migrating to 2-way video communications, which requires those at both ends to have decent uploading. We are just now seeing the early trials of virtual presence where communications will be by big-bandwidth virtual holograms at each end of the communications.

Davis is like many urban areas in that the broadband products available have slow upload speeds. Comcast is the cable incumbent, and while they recently introduced a gigabit download product, their upload speeds are still paltry. DSL is offered by AT&T which has even slower upload speeds.

Technologies differ in their ability to offer upload speeds. For instance, DSL is technically capable of sending the data at the same speeds for upload or download. But DSL providers have elected to stress the download speed, which is what most people value. So DSL products are set with small upload and a lot of download. It would be possible to give a customer the choice to vary the mix between upload and download speeds, but I’ve never heard of an ISP who tried to provide this as an option to customers.

Cable modems are a different story. Historically the small upload speeds were baked directly into the DOCSIS standard. When Cable Labs created DOCSIS they made upload speeds small in response to what cable companies asked from them. Until recently, cable companies have had no option to increase upload speeds beyond the DOCSIS constraints. But Cable Labs recently amended the new DOCSIS 3.1 standard to allow for much upload speeds of nearly a gigabit. The first release of the new DOCSIS 3.1 standard didn’t include this, but it’s now available.

However, a cable company has to make sacrifices in their network if they want to offer faster uploads. It takes about 24 empty channels (meaning no TV signal) on a cable system to provide gigabit download speeds. A cable company would need to vacate many more channels of programming to also offer faster uploads and I don’t think many of them will elect to do so. Programming is still king and cable owners need to balance the demand for more channels compared to demand for faster uploads.

Fiber has no real constraints on upload speeds up to the capability of the lasers. The common technologies being used for residential fiber all allow for gigabit upload speeds. Many fiber providers set speeds to symmetrical, but others have elected to limit upload speeds. The reason I’ve heard for that is to limit the attractiveness of their network for spammers and others who would steal the use of fast uploading. But even these networks offer upload speeds that are far faster than the cable company products.

As more households want to use uploading we are going to hear more demands for a faster upload option. But for now, if you want super-fast upload speeds you have to be lucky enough to live in a neighborhood with fiber-to-the-home.

Exit mobile version