Fastly blames software bug for major global internet outage

Bill Mount

Fastly Inc. (FSLY.N), the company behind a major global internet outage this week, said on Wednesday the incident was caused by a bug in its software that was triggered when one of its customers changed their settings. Tuesday’s outage raised questions about the reliance of the internet on a few […]

Fastly Inc. (FSLY.N), the company behind a major global internet outage this week, said on Wednesday the incident was caused by a bug in its software that was triggered when one of its customers changed their settings.

Tuesday’s outage raised questions about the reliance of the internet on a few infrastructure companies. Fastly’s issue knocked out high traffic sites including news providers such as The Guardian and New York Times, as well as British government sites, Reddit and Amazon.com (AMZN.O).

“This outage was broad and severe, and we’re truly sorry for the impact to our customers and everyone who relies on them,” the company said in a blog post authored by Nick Rockwell, its senior engineering and infrastructure executive.

He said the problem should have been anticipated.

Fastly operates a group of servers strategically placed around the world to help customers move and store content close to their end users quickly and safely.

The New York Times office is pictured in the Manhattan borough of New York City, New York, U.S., September 28, 2020. REUTERS/Carlo Allegri

The company post gave a timeline of events and promised to examine and explain why Fastly had failed to detect the software bug during its own testing process.

Fastly said the bug was in a software update shipped to customers on May 12 but was not triggered until one unidentified customer carried out settings changes that triggered the problem “which caused 85% of our network to return errors.”

Fastly noticed the outage within a minute it occurring at 0947 GMT, and engineers worked out the cause at 1027 GMT. Once they disabled the settings that triggered the problem, most of the company’s network quickly recovered.

“Within 49 minutes, 95% of our network was operating as normal,” the company said.

Its networks were fully recovered at 1235 GMT and it began rolling out a permanent software fix at 1725 GMT, Fastly said.

Our Standards: The Thomson Reuters Trust Principles.

Next Post

After FaceTime, here’s how Apple can half-ass other apps to Android

Big news from WWDC: FaceTime will be available on Windows and Android! Apart from! Not really! Because the port! Is total shit! In case you missed the update, Apple has spent the past year trying to copy Zoom. Part of this is that FaceTime, its video calling app, is opening up. […]