Tag Archives: carrier hotel

Lack of Exchange Points

There are many folks making the argument that the country doesn’t have enough carrier exchange points. An exchange point is a physical location where multiple carriers meet for purposes of exchanging traffic.

The idea of exchange points started in the late 1990s as a result of the Telecommunications Act of 1996. That new law allowed for voice competition, and the national voice network was controlled by regulated telephone monopolies. Big telcos like Verizon and the other Baby Bells resisted the idea of competition and made it challenging and expensive to connect to the public switched telephone network at their voice switches. This prompted the formation of CLEC hotels, which were essentially data centers near the large telco switches where competitive carriers could make connections with each other.

Over time, broadband grew to be far more important than voice, and became the focus for the desire to interconnect. Over time these same locations were renamed as carrier hotels or Internet Exchange Points (IXPs). The exchange points attracted last-mile ISPs, cellular carriers, middle-mile and long-haul fiber providers, corporate networks, and eventually, content delivery networks (CDNs) from companies like Google and Facebook. The CDN category has grown to include those who are exchanging AI traffic.

I don’t know if this is an accurate statistic, but I’ve heard several people claim there are fourteen or fifteen states that don’t have a major exchange point. This might be true if you use the definition of an exchange point to be a place where everybody meets. The major exchange points are in or near to major cities and include places like 60 Hudson Street in New York City and the Internet exchange point in Ashburn, Virginia.

The major exchange points only make sense for large carriers that are exchanging large amounts of traffic. I recently saw that in the 60 Hudson IXP in New York City that it costs $1,000 per month just to carrier traffic from one floor to the next inside the facility. Only carriers with economies of scale can justify the high cost of locating at the major IXP sites. Most IXPs are owned by somebody other than carriers and ISPs and are viewed as a real estate investment.

There is a big downside to ISPs that are not located close to an IXP. They must lease fiber transport with somebody that can carry their traffic from the local market to the nearest IXP. Such transport can be expensive, particularly for small ISPs who must buy such transport from the telcos or cable companies they are competing against. Lack of affordable connection to the Internet is one of the factors that stop ISPs from creating connections in remote rural areas far off the beaten path. It’s interesting that the BEAD grants want to fund the last-mile networks in such remote places but are not willing to find any significant middle-mile fiber needed to make the connection to affordable transport.

There are good arguments to be made for the creation of smaller IXPs that are closer to where ISPs operate last-mile networks. One benefit of more points is peering, which is the process of routing traffic in a way that avoids having to send it through the major Internet IXPs. An ISP might create a peering point to directly connect to somebody like Google or Facebook to exchange traffic. Peering saves on transport costs, but it also saves on paying a fee to exchange traffic at the big IXPs, which is charged per megabit. For most ISPs, more than half of their data traffic goes to and from a handful of companies like Google, Meta, Amazon, Netflix, and Microsoft.

Perhaps the biggest benefit for ISPs to meet other carriers close to home is the ability to create redundancy. ISPs have learned that it’s dangerous to send all Internet traffic to a single connection point. A fiber cut or electronics failure along that route means the ISP and its customers will go dead. Regional IXPs open up the possibility of routing traffic to multiple large IXPs.

Carrier Hotels

Today’s blog talks about a critical part of the broadband network that most people don’t know about – carrier hotels. These are locations that have been created for the specific purpose of allowing carriers to connect to each other.

 

The need for carrier hotels became apparent in the year after the passage of the Telecommunications Act of 1996. That new law allowed local competition for telephone service. New competitive exchange carriers (CLECs) had to tie their network into the public switched telephone network (PSTN), which was largely controlled by the big Bell Telephone companies and a few others.

 

The big telcos purposefully made it ponderous, expensive, and time-consuming to collocate inside a telco central office. The interconnection agreements between a CLEC and a telco were several inches thick, and the rules related to collocation and interconnection were over fifty pages long – and the telcos meticulously adhered to every rule. The telco got to approve the use of every piece of equipment that went into their space – and that meant only using the brands of gear that the telcos used. CLECs had to pay an expensive telco employee to accompany them every time they visited their equipment. It could easily take nine months to a year to establish a single new collocation.

 

A few smart entrepreneurs came up with the idea of creating a collocation space very near to major telco offices. The language in the 1996 Act allowed CLECs to request collocation at any technically feasible location. It took a few fights at state commissions to allow collocation outside of Bell offices, but regulators universally agreed that was the intention of the 1996 Act. Once the use of external collocation sites was blessed, carrier hotels sprang to life and thrived.

 

Carrier hotels make money by selling collocation to carriers. All types of carriers come to the carrier hotels – long-distance carriers, CLECs, ISPs, wireless carriers, cable companies, major content providers, and specialty carriers of all types. A big carrier hotel in a major city houses hundreds of domestic and international carriers.

 

There are a number of benefits for carriers to locate in a carrier hotel. The most obvious is to make it easy to connect to other carriers and services. In today’s environment, an added benefit is the high degree of security at the typical carrier hotel. Carrier hotels are convenient places to exchange vast amounts of data.

 

The typical carrier hotel is also connected to multiple major fiber routes, so it’s an easy place for carriers to jump onto transport routes provided by fiber owners or companies that have leased or bought fibers on major fiber routes.

 

Another industry function provided by the carrier hotel is to create competition that holds down prices. There is fierce competition in the biggest carrier hotels for bandwidth, transport, and other services, and prices are kept competitive by having multiple carriers willing to provide the same service to carriers.

 

A lot of the traffic that we think of as the “Internet’ changes hands in carrier hotels. The direct fiber connections within the hotel allows for keeping bits moving in the most efficient manner. A given carrier might interconnect with a dozen or more other carriers to hand-off specific subsets of data.

 

It’s rare for a carrier hotel to hit the news. The most famous event at a carrier hotel occurred at the carrier hotel at 60 Hudson Street in Manhattan. That location got knocked out of service by the attack on the neighboring Twin Towers on September 11. The carrier hotel went dark, which contributed to widespread broadband and cellular outages, particularly in New York City. The good news was that the carrier hotel was up and running by 9:00 AM the following morning.