Will Data Centres Become the Biggest Bottleneck in AI?
| Key Takeaways | ᐯ |
- AI growth depends on reliable power, cooling, networking and compute capacity.
- Infrastructure constraints can raise cloud costs and limit regional availability.
- Advanced chips require data centres built for higher power density and heat management.
- Efficient model selection and workload design can reduce compute demand.
- Enterprises should evaluate scalability, latency and long-term operating costs before deployment.
AI demand is driving one of the largest expansions of computing infrastructure in recent history.
According to a Reuters report published in July 2026, Hut 8 signed a $9.8 billion lease covering 352 megawatts of AI data centre capacity at its Texas campus. The timeline illustrates the scale of investment and lead time involved in bringing major AI infrastructure online.
Businesses are deploying reasoning models, multimodal applications and AI agents across products, workflows and customer experiences. As these workloads expand, so does demand for power, cooling and compute capacity.
Data centre availability could shape how quickly AI products launch, how much they cost to operate and which companies can scale them successfully.
AI Is Becoming a Physical Infrastructure Industry
Early conversations about generative AI focused on model size, speed and output quality. Cloud platforms kept much of the supporting infrastructure out of sight.
Training advanced models requires large clusters of GPUs and other AI accelerators. Serving millions of users creates continuous demand for computing power. Image generation, video tools and AI agents increase that demand further.
The International Energy Agency projects that global data centre electricity consumption could rise from about 485 terawatt-hours in 2025 to nearly 950 terawatt-hours by 2030.
AI scalability now depends on energy, hardware, cloud capacity and networking. A capable model creates commercial value when companies can operate it reliably and at a sustainable cost.

Power May Become the Most Immediate Constraint
Electricity is among the hardest infrastructure requirements to scale quickly.
Large AI data centres can require hundreds of megawatts of power, while some announced campuses are expected to operate at gigawatt scale. Supporting this level of demand requires major grid planning, transmission capacity and long-term energy investment.
Supporting this level of demand requires extensive preparation. Utilities must confirm that local generation, substations and transmission systems can handle the additional load. New infrastructure may need approval and construction before a facility can reach full capacity.
A data centre can sometimes be built faster than the grid infrastructure needed to power it. The IEA notes that facilities may become operational within two or three years, while wider energy infrastructure often takes longer, leaving companies waiting for adequate power after construction is largely complete.
Electricity access is becoming a critical part of compute availability. Every processor requires a suitable rack, network connection, cooling system and dependable power supply.
Businesses purchasing AI through the cloud may experience this constraint through reduced regional availability, capacity limits or higher service prices.
More Powerful Chips Need More Capable Facilities
Advanced AI chips can process larger workloads. Their operation also requires higher power density and stronger heat management within each rack.
Many older data centres were designed for traditional enterprise systems. Their electrical and cooling infrastructure may require major upgrades before supporting dense AI clusters.
Installing new accelerators can involve liquid cooling, higher-capacity power systems and redesigned rack layouts. Processor access represents one part of the total capacity requirement.
Facility readiness has therefore become part of hardware strategy. Enterprises running private data centres must assess the long-term value of upgrades and consider cloud or colocation providers for demanding AI workloads.
Cooling Capacity Will Influence AI Performance
Dense AI racks generate significant heat, reducing the effectiveness of conventional air-cooling systems. Many new data centres are adopting direct-to-chip liquid cooling and other advanced thermal technologies.
Cooling design affects hardware reliability, rack capacity and total energy consumption. According to the International Energy Agency’s 2025 Energy and AI report, cooling and other supporting infrastructure could account for around 20 percent of the net increase in global data centre electricity consumption through 2030.
Water availability can influence where data centres are built, particularly in regions facing resource constraints. Facilities that rely on water-intensive cooling may face higher operating risks, tighter permitting requirements or limits on future expansion.
For enterprises, cooling efficiency can influence cloud costs, sustainability reporting and the long-term economics of running AI workloads at scale.
Construction Timelines Could Slow AI Expansion
Data centres require long physical development cycles.
A large facility may involve land acquisition, environmental reviews, utility agreements, permits, construction and specialised equipment installation. Delays at any stage can affect the date when computing capacity becomes available.
Transformers, generators, switchgear and high-voltage equipment must be manufactured and delivered. Skilled engineers, electricians and construction teams are also required to assemble and commission each site.
Large announcements about future AI capacity should be interpreted carefully. Planned capacity may require several years before becoming operational.
Technology roadmaps often assume that computing power will expand over time. Delayed facilities can affect model training, product launches and regional expansion.
AI Economics Will Be Shaped by Infrastructure
Data centres carry substantial costs across electricity, cooling, networking, maintenance and hardware replacement. Growing demand can influence cloud pricing, API fees and usage limits.
The financial impact often becomes visible after deployment. An AI tool’s operating cost can rise significantly as usage reaches thousands of employees or customers.
Inference costs continue throughout the life of an application. Every generated response, analysed document and automated action consumes computing resources.
Companies with access to affordable compute can scale faster and conduct more experiments. Enterprise AI planning should therefore account for long-term operating costs before a solution moves from pilot to production.

Efficiency May Matter More Than Model Size
Many business tasks can be handled by smaller specialised models. Classification, summarisation, information extraction and routine support are common examples.
Architecture choices also matter. Techniques such as retrieval-augmented generation can improve task performance by grounding responses in relevant enterprise data without relying solely on larger models.
Techniques such as model compression, quantisation, caching and intelligent routing can reduce computing requirements and operating costs. Advanced reasoning models can then be reserved for tasks where their additional capability justifies the higher compute cost.
The IEA estimates that improvements across hardware, software and infrastructure could reduce data centre electricity demand by more than 15 percent by 2035 while supporting the same level of digital services.
Efficiency has become a practical business capability that influences performance, cost and long-term deployment value. Achieving it requires careful model selection, well-designed workflows and clear visibility into inference costs.
12th Wonder helps enterprises apply these principles by designing AI systems around real workload requirements, scalable architecture and production economics.
What Enterprises Should Do Now?
Enterprises should plan for AI infrastructure constraints before moving from pilot to production.
Usage forecasts must account for scale. A tool serving 50 employees creates a different cost profile from one used by thousands of employees or customers.
Model selection should reflect task complexity, with suitable systems chosen for predictable workflows, deeper reasoning and complex outputs.
Architecture should remain flexible across models and cloud providers. This approach reduces exposure to pricing changes, regional capacity limits and service restrictions.
Teams should track cost per completed task, latency, data residency and resource use. Strong LLM evaluation and observability practices can help organisations monitor quality, reliability and operating performance as usage grows.
Infrastructure requirements should also form part of vendor evaluation. Enterprises need visibility into hosting regions, capacity guarantees, service limits and future pricing models.
Will Data Centres Become the Biggest AI Bottleneck?
Data centres could become the biggest bottleneck in AI growth, particularly in regions where grid development cannot keep pace with rising electricity demand.
The pressure will vary across markets. Regional constraints may include power shortages, construction delays, limited high-density facilities and higher cloud costs.
The IEA expects global data centre electricity demand to roughly double by 2030. Efficient architecture will become increasingly important as organisations compete for available computing capacity.
Enterprises that match models to real workload needs will be better positioned to control costs, maintain performance and scale reliably.
Conclusion
The future of AI will be shaped by the infrastructure capable of carrying its growth.
Power, cooling, compute access and deployment costs will influence how quickly enterprises can move from promising use cases to reliable systems operating at scale.
Strong AI architecture brings these decisions together. Model selection, workload design and cost visibility help organisations build systems that remain practical as usage expands.
12th Wonder helps enterprises turn that foundation into measurable value through model evaluation, scalable architecture and workflow optimisation.
AI will create lasting advantage for businesses that design for scale from the beginning.
FAQ
Is Your AI Ready to Scale?
Evaluate model choice, infrastructure requirements and inference costs before usage expands.
