Datacentre operators ‘hesitant’ over how to proceed with server farm builds as AI hype builds

Debates about datacentre design

The hesitancy Lindqvist talks about is backed by data from real estate consultancy CBRE, which regularly publishes reports tracking how the supply and demand for colocation capacity changes on a quarterly basis in Frankfurt, London, Amsterdam, Paris and Dublin.

As reported by Computer Weekly in August 2023, the company picked up on a slowdown in the amount of new colocation supply coming online in the second quarter of 2023, although it cited the “tremendous amount” of new capacity deployed in the second half of 2022 as being the causal factor, rather than operators having misgivings about the longevity of the AI trend.

Forecast data released by IT market watcher Gartner in August 2023, meanwhile, predicts a 20.9% year-on-year increase in revenue generated by the sales of semiconductors that are designed to help AI workloads run in datacentres, edge environments and endpoint devices in 2023, to $53.4bn.

“The developments in generative AI and the increasing use of a wide range of AI-based applications in datacentres, edge infrastructure and endpoint devices require the deployment of high-performance graphics processing units and optimised semiconductor devices,” said Alan Priestley, vice-president analyst at Gartner. “This is driving the production and deployment of AI chips.”

And while Gartner’s figures suggest the AI trend is going to continue to take the world of tech by storm, the market watcher’s recently published Hype Cycle for emerging technologies lists generative AI as being at the “peak of inflated expectations”, which might go some way to explaining why operators are reluctant to rush to kit out their sites to accommodate this trend.

For colocation operators that are targeting hyperscale cloud firms, many of which regularly talk up the potential for generative AI to transform how enterprises operate, there is perhaps less reticence, said Onnec’s Linqvist.

“If you look at the hyperscalers, yes, they will do that because they have a big future plan that AI is happening within their software, but the [retail] colocation providers could be in a different spot,” he added.

“Should they aim for AI, or should they [continue] to aim for traditional CPU racks? Traditional cooling like airflow, or should they use liquid cooling? That is a decision on a high level because it’s going to be, “Which market am I targeting?’”

So what does Linqvist think it will take to get operators to overcome their hesitancy? More proven use cases for AI in all its forms would be a start, he said.

“It would be a good idea to have that, but it is hard to get that, so [it] is important to have an open-minded, holistic view on how we design [datacentres] so we’re not just designing them [to accommodate] AI,” he said. “It needs to be flexible, scalable and modular.”

Expanding on this theme, he said it was important that operators take into account the interconnectedness that exists between the different disciplines that contribute to the overall way a datacentre operates.

“When you design a datacentre, you need to think about power, cooling and all the other disciplines that need to be connected, because if you change one thing, the other one will also need to be changed, and you need to have them as aligned as possible,” he continued.

“You also need to think a little bit outside the box. Not just about what’s happening this year or next year, because, for us, the cabling that we are providing is an infrastructure we think is going to live in the datacentre for 10 to 15 years without being changed. [But] the hardware is going to change within three years, so how can we make sure the cabling that will support that hardware is going to be as good as it can be?”

To address these challenges, Linqvist advocates for operators taking a multi-disciplinary approach to designing their facilities to ensure they are future-proofed against whatever new technology trends come along.

“You need to engage all disciplines. You need to work together in teams, getting out the details before you actually start, and everyone needs to sit down together. And it’s a lot, because in the datacentre you have a network team, a storage team, a facility team, a datacentre director and a manager,” he said. “All these people need to get aligned and look into the future a little open minded [as they figure out] what they want to provide to the market.”