Back to the Future.

Somewhere in a data centre in Sydney, and another in Melbourne, a handful of servers came to on Wednesday morning and decided, with the quiet confidence of the badly informed, that it was November 2006. John Howard was prime minister. The iPhone did not exist. Telstra was mid-privatisation, and mobile networks in Australia had never heard of anyone needing to reach triple zero from a phone that thought it belonged to the previous decade.

This is, apparently, what a "software defect" looks like from the inside. A firmware update went wrong, a GPS timing node miscounted, and Telstra's clocks rolled back 1024 weeks, just under twenty years, to a date so specific it reads less like an error and more like nostalgia with consequences. Engineers have known about this particular failure mode since before most of Telstra's current customers owned a mobile at all; the GPS week-number rollover is the kind of bug that gets fixed in advance, in the manual, by people paid specifically to remember that clocks eventually run out of digits and start again. It happened anyway, on a Wednesday, to one of the country's two largest telcos, ten months after the other one made the same kind of headline for a different reason entirely.

The consequences were not nostalgic. Trains across regional Victoria stopped, because V/Line's radio communications run through Telstra, and a network insisting it was 2006 apparently had no record of a train that needed to move in 2026, while EFTPOS terminals failed and mobile data disappeared for what Telstra initially described, with impressive understatement, as "tens of thousands" of customers, before conceding the true number was likely considerably higher. And 333 emergency calls did not connect properly, prompting a program of welfare checks that ran, by Wednesday evening, to phoning people who had just dialled triple zero to ask if they were all right, a service Telstra was, at the time, in the process of failing to provide.

Communications Minister Anika Wells observed that telcos are "the least trusted industries in Australia," offered as diagnosis rather than confession, from the minister whose department is meant to be doing something about it. The Opposition's Sarah Henderson pointed out that Australians are still waiting on the results of the inquiry into Optus's own triple-zero failure last September, which suggests the regulator's investigative timeline may itself be running on a Telstra clock.

Telstra's chief financial officer, Michael Ackland, was at pains to clarify that this was not a cyber attack. Nobody hacked Telstra. Nobody needed to. The company managed, unassisted, what a hostile state actor would have needed months to arrange: a national network convinced it was serving customers who, in several cases, had not yet been born.

Twenty-six years ago, an entire industry spent a small fortune making sure the millennium did not break every computer on earth, because someone had remembered in advance that clocks run out of digits. That was the expensive lesson. Telstra has now paid for the cheap version, twenty years late, on a Wednesday, because a firmware update failed at its only job.

Services were restored by 4pm. The clocks have presumably been informed of the year. Whether the rest of the network has been informed that vigilance isn't something you get to schedule is a question now sitting with the Australian Communications and Media Authority, which is getting around to asking it in its own time.

If you know someone who’d appreciate this, they probably will. Please share. Sharing's nice.
...
If you enjoyed this article and would like to see more, 'Buy the Goose a Coffee →'.
...
The views expressed are those of the correspondent. Factual claims draw on publicly available sources.