Skip to main content

Data Center

Beyond Hyperscalers: Here’s the Next $1 Trillion AI Infrastructure Opportunity

Written by

Beth Kindig

Founder, CEO and Lead Technology Analyst

Published: October 30, 2026

Last Updated: October 30, 2026

Since 2022, Big Tech capex has been the clearest barometer of AI demand. But the market’s reaction to Google’s latest earnings shows investors are questioning how long that spending can last. While the market frets over hyperscalers’ cash flows, a second wave of AI infrastructure spending has quietly emerged, driven by enterprises and neocloud customers.  

The strength in non-hyperscaler revenue is quite visible in Nvidia’s earnings reports over the past two quarters, which was the topic of our recent free newsletter Nvidia Fiscal Q2: The AI Giant Answers to Losing Market Share, when we stated: “This quarter, hyperscalers represented revenue of $48.7 billion compared to AI Clouds, Industrial and Enterprise customers (ACIE) revenue of $40.3 billion, yet ACIE had a stronger growth rate of 138.5% compared to the hyperscaler segment at 101.2%.”  

Importantly, this trend is not limited to Nvidia’s report. AI server OEMs, such as Dell, Super Micro and HPE are echoing that enterprises and neoclouds are contributing to their results. Dell, in particular, laid out a forecast for 200 GW of AI data center growth through 2030, with enterprise and neoclouds expected to drive half of that growth, or 100 GW. Dell estimates this could create a $1 trillion AI infrastructure opportunity over the next four years.   

On the heels of Google’s cash flows turning deeply negative, we map out the upcoming tailwinds for AI servers, and why a new growth phase in 2027 could lead to both higher shipment volumes and more revenue per deployment.  

Enterprise and Neocloud Customers Could Help Drive a $1 Trillion AI Infrastructure Opportunity

Our firm’s back of the napkin math shows that Nvidia’s ACIE segment could potentially overtake hyperscalers in two to six quarters. This is an important development as it results in Nvidia’s revenue being more resilient as hyperscalers shift capex toward designing and deploying their own custom chips. 

As discussed above, ACIE revenue grew faster than hyperscaler revenue last quarter at 138.5% compared to 101.2%, respectively. After reclassifying one company, the QoQ growth for ACIE was 25% compared to hyperscalers at 13%. Within this, sovereign AI revenue and regional neoclouds reported growth of 35% QoQ and tripled YoY. 

Depending on how you model the two-quarter lumpiness, ACIE can conservatively overtake hyperscalers in 5-6 quarters at a 14% QoQ growth rate versus 10% QoQ growth rate for hyperscalers, or as soon as 2 quarters if the Q2 pace continues. 

Chart projects Nvidia ACIE revenue rising from $40.3B to $66.2B, overtaking hyperscaler revenue at $64.8B in Q1 FY28.
Nvidia’s AI Clouds, Industrial and Enterprise (ACIE) segment is projected to grow from $40.3 billion in Q2 FY27 to $66.2 billion in Q1 FY28, surpassing hyperscaler revenue for the first time. The forecast assumes ACIE grows at roughly 18% per quarter versus approximately 10% for hyperscalers, highlighting the increasing importance of enterprise, sovereign AI, and neocloud demand within the AI infrastructure market.

In early September, Dell was in agreement with Nvidia’s results, stating that enterprises and neoclouds could contribute half of AI data center capacity growth through 2030, creating a $1 trillion total addressable market (TAM): 

“We’re expecting AI to be 75% of all data center demand by 2030, adding 200 gigawatts of power over that same time frame. And half of that, we believe, is right in our sweet spot with our customers, the Neoclouds, sovereigns and enterprises. And if you look at that math, we think the opportunity in front of us is more than $1 trillion over that time frame.”   

Dell’s extensive presence with 6,500 enterprise and neocloud customers (with more than half those added in the last three quarters), and expectations for enterprise agentic AI to be the “single largest workload by 2028” also suggest this $1 trillion TAM will primarily be driven by enterprise and neocloud growth.  

Although it may seem counterintuitive for Nvidia, Dell or Super Micro to emphasize enterprise and neocloud customers over the hyperscalers and their $1 trillion capex next year, the reason is simple.   

Unlike the hyperscalers, these customers do not have those budgets to splurge tens of billions on custom chips. Instead, demand is more concentrated in ready-to-deploy servers that can immediately be brought online to generate revenue for immediate ROI, which Dell and Super Micro can do in as little as six hours to one day.   

Enterprise AI Deployments Increase Revenue per Server Deployment

Enterprise offers another avenue for Dell and Super Micro to increase their value-add due to more rack complexity and increased density. The spend comes with strong attach rates in higher-margin storage, networking and, especially for Dell, services contracts. 

According to Dell:  

“The momentum with enterprise, best measured by number of customers, the number of customers that are buying repeatedly is all up and the indicators are strong. And they tend to buy more storage, and they tend to buy more networking when they engage with us, a more complete solution.”  

Increasing attach rates, particularly within storage, are a big value proposition for AI server companies, as higher attach rates mean Dell and Super Micro are able to capture a much larger revenue opportunity per deployment. For example, analysts last quarter suggested Dell’s storage attach opportunities ranged from $2-3 per $1 of servers. This can then flow down the line and aid operating margins.  

Agentic AI is also a multiplier to storage attach, as agentic workflows inherently are much more intensive than simple chatbot query workloads. Autonomous agents will continuously call tools, retrieve data, invoke models, evaluate intermediate outputs, and repeat those steps into dozens of operations. This is expected to drive a 15X increase in tokens per user, per Arm, while also increasing the size of KV cache data needing to be stored to maintain model context.  

This increase in storage intensity from multi-step inference or KV cache requirements also presents an opportunity for server OEMs to differentiate themselves with storage offerings. For example, Dell is leveraging its storage IP portfolio to create a ‘persistent’ KV cache storage tier, which it says can offer up to a 19x faster time‑to‑first‑token and 5.3x higher tokens-per-second.  

AI’s “safe” bets like $NVDA and Big Tech are underperforming the $QQQ YTD. Meanwhile, some of 2026’s biggest triple-digit winners are hiding deeper in the AI stack. My Q4 Top 20 AI Stocks report, released this week, breaks down the lesser-known companies leading the charge. Previous reports identified an energy stock up more than 1,230% since our initial entry last year, an optical networking stock up 173%, and two of our largest AI positions up 153% and 138% year to date.  

Subscribe to access the 100+-page Q4 Top 20 AI Stocks report: GET PREMIUM ACCESS

Rack-Scale CPUs Expand AI Infrastructure Beyond Traditional GPU Systems

Up until this point, the AI server industry has only faced two high-volume platforms in a 72-GPU scale-up system, Blackwell and Blackwell Ultra. As we head into the end of 2026 and into 2027, rack-scale solutions are broadening, across both GPU and now CPU roadmaps.   

Over the past year, an important development is that standalone CPUs are beginning to migrate to rack-scale solutions with releases from major CPU players AMD, Arm and Nvidia. This expansion offers a bullish readthrough for AI server manufacturers as rack-scale CPUs introduce a new category of high-value systems beyond GPU deployments. The revenue per deployment increases as rack-scale systems require greater compute density and additional networking and power and cooling requirements. 

AMD earlier this month unveiled its new ‘Helion’ platform, marking its first CPU-only racks for agentic AI deployments. AMD is launching Helion in two configurations, the hyperscale-oriented CPU-only rack offering up to 32,768 Venice CPU cores, and an enterprise configuration featuring up to 16 MI355X GPUs alongside CPUs. Although the announcement is relatively fresh, AMD appears to be moving quite quickly, with the first Helion platforms already under development for a November launch.  

AMD’s release also follows Arm, who made the entry into physical chip development and rack-scale CPU systems earlier this year in March with its AGI CPU. As we outlined in our newsletter, Arm Stock Could Win as Agentic AI Shifts the Bottleneck to CPUs, Arm’s new chip will ship in both air-cooled and fully liquid-cooled racks to meet customers where their data center infrastructure lies.  

In an air-cooled rack, Arm can pack 30 blades (or 60 CPUs) for a total of 8,160 cores in a 36kW power envelope, saying this configuration can deliver up to 2X the performance per rack versus x86 chips based on its internal estimates. The fully liquid-cooled rack, in partnership with Super Micro, consumes 200kW and packs 336 CPUs, delivering a total of up to 45,696 cores. 

In fiscal Q1 earnings in July, Arm continued to maintain its view for $1 billion in AGI CPU revenue across FY27 and FY28, with supply in place to hit that target. Arm says the demand pipeline still exceeds $2 billion.  

Nvidia Vera Could Become a $40 Billion Rack-Scale CPU Opportunity

Nvidia explained in Q2 that it expects Vera CPUs to be “deployed by every major hyperscaler, neocloud, AI lab, and system OEM with shipments already underway to our lead partners, including OCI, SpaceXAI and starting this quarter, AWS.”   

Nvidia sees $20 billion in server CPU demand in FY27 with the potential to double to $40 billion in FY28; for comparison, this is roughly two-thirds of Intel’s total revenue this year. Arm is also entering hardware for the first time with its AGI CPU racks, featuring 152 or 336 CPUs in liquid cooled racks.   

Beth Kindig, founder and lead tech analyst of I/O Fund

Get Our Free Weekly Stock Newsletter

Get weekly stock insights, market analysis, and technology updates straight to your inbox.

  • Weekly stock insights
  • Market analysis
  • Technology updates

This path from one high-volume rack-scale generation from Nvidia to several high-volume rack scale systems ramping across both GPUs and CPUs presents strong growth opportunities for the AI server industry.   

Shipment volume forecasts also reflect this, with AI server shipment growth projected to accelerate roughly 7 points to 31% YoY, driven by a 50%+ increase in NVL72 shipments across Blackwell and Rubin. Ultimately, this creates more opportunities for AI server OEMs to move up the value chain, as rack density rises and systems become increasingly complex.   

As stated above, that rising rack complexity opens the door for server OEMs to capture more value per deployment, from greater system-level integration across power delivery, liquid cooling, storage, networking or even software.  

TrendForce expects NVL72 rack shipments to rise more than 50% next year, while Rubin ASPs roughly doubled from Blackwell to an estimated $7.8 million. Together, those forces are expected to drive total rack output value of more than 3X to $711 billion, creating “significant momentum” for server OEMs as well as power and cooling suppliers.   

Chart shows NVIDIA NVL72 rack system output value rising from $89B in 2025 to $711B in 2027, led by Rubin platforms.
TrendForce forecasts NVIDIA NVL72 rack system output value to increase from $89 billion in 2025 to $711 billion in 2027, driven by the transition from Blackwell (GB200/GB300) to Rubin (VR200/VR300 Ultra) platforms. The chart highlights a projected 8x increase in rack system value over two years, reflecting rising AI infrastructure spending, higher rack densities, and more complex rack-scale deployments.

Nvidia’s ‘extreme co-design’ with Rubin takes it a step further with the introduction of specialized storage or inference-accelerator racks such as its Bluefield STX-4 and Groq 3 LPX racks. Management expects Rubin to mark the fastest product ramp in its history and generate approximately $20 billion in revenue next quarter.   

By the end of 2027 and into 2028, Rubin Ultra will take this a step further, as it marks the next expansion of the scale-up system to the NVL144 and the NVL576, a 2X to 8X increase in GPUs per system. This is likely to strengthen server OEM value-add as storage, cooling, and power delivery content continues to rise.   

Liquid Cooling to Reach 53% Share in 2026

This year marks a turning point for liquid cooling, with adoption expected to surpass 50% for the first time. As power consumption rises with each new chip generation, traditional air cooling is reaching its limits, accelerating the shift toward liquid cooling. 

We have long discussed the increasing power consumption with upcoming GPU platforms from Nvidia, starting with our coverage in 2024 on AI Power Consumption: Rapidly Becoming Mission-Critical. Nvidia’s Blackwell generation and the introduction of the NVL72 drove rack power consumption up roughly 2.6X versus Hopper to 130kW, while Rubin is expected to take a slight step up to 150kW, per Applied Digital.   

Rubin Ultra and that expansion to the NVL576 is expected to drive rack power consumption up 4X to 600kW, while Nvidia’s future roadmap is expected to surpass 1MW by Feynmann Ultra by 2029 to 2030.   

Chart shows NVIDIA AI rack power rising from 14.4 kW with A100 to an estimated 1.2 MW by 2030, driving liquid cooling adoption.
NVIDIA’s AI infrastructure roadmap points to a dramatic increase in rack power density, from 14.4 kW with A100 systems to an estimated 1.2 MW by 2030, representing roughly an 80X increase in rack power. The chart highlights major power jumps across Hopper, Blackwell, Rubin, Rubin Ultra, and future Feynman platforms, alongside estimated GPU TDPs rising from 350W to more than 6,000W. These trends underscore why liquid cooling is becoming increasingly critical for next-generation AI data centers.

This trend is no longer isolated to Nvidia, as AMD’s Helios is also pushing the thermal boundary. Reference designs from Schneider Electric for Helios show support for 246kW AI racks, pushing the upper limit of what the highest-density liquid cooling solutions and highest-density data center infrastructure can currently support at 250kW.   

Although air-cooled options still exist for the latest GPUs such as Blackwell Ultra (with Super Micro offering up to 576-GPU air-cooled Blackwell Ultra clusters), liquid cooling is a necessity to maximize data center density and rack deployments within fixed power envelopes. As a result, liquid cooling adoption is forecast to accelerate sharply in 2026 and further in 2027, driven by the continued ramp of Blackwell Ultra and upcoming ramps for Rubin and Helios.   

Chart shows liquid cooling adoption for AI chips rising from 6% in 2023 to 59% in 2027, surpassing 50% in 2026.
TrendForce forecasts liquid cooling penetration among AI chips to rise from 6% in 2023 to 59% in 2027, representing nearly 10x growth in four years. The chart shows liquid cooling surpassing the 50% threshold in 2026, reflecting rising rack power densities and its growing importance in next-generation AI infrastructure.

Super Micro’s DLC rack capacity supports this acceleration in liquid cooling penetration, with half of its monthly 6,000 rack capacity geared towards DLC racks supporting up to 250kW platforms. This is double its 1,500 DLC rack per month capacity just six quarters ago in Q2 2025.   

As noted above, this sharp increase in liquid cooling adoption is a path for Super Micro and Dell to increase revenue captured per deployment, as a greater proportion of racks include OEM-added cold plates, CDUs, and other cooling solutions.   

Conclusion

The AI server industry is entering a new growth phase in 2027, with two major catalysts converging. First, AI infrastructure spending is broadening beyond hyperscalers to enterprise and neocloud customers. Second, rack-scale systems across both GPUs and CPUs can lead to more value for each deployment. 

However, not all server manufacturers will capture this growth equally. Servers are a low-margin business, contributing to extreme volatility among the major players. This makes it important to look beyond the server manufacturers themselves to the companies supplying the critical components behind this strong lineup of rack-scale AI systems that are preparing to ship.  

AI’s “safe” bets like $NVDA and Big Tech are underperforming the $QQQ YTD. Meanwhile, some of 2026’s biggest triple-digit winners are hiding deeper in the AI stack. My Q4 Top 20 AI Stocks report, released last week, breaks down the lesser-known companies leading the charge.  

Previous reports identified an energy stock up more than 1,230% since our initial entry last year, an optical networking stock up 173% from our first entry, and two of our largest AI positions up 153% and 138% year to date.  

Subscribe to access the 100+-page Q4 Top 20 AI Stocks report: GET PREMIUM ACCESS 

Please note: The I/O Fund conducts research and draws conclusions for the company’s portfolio. We then share that information with our readers and offer real-time trade notifications. This is not a guarantee of a stock’s performance and it is not financial advice. Please consult your personal financial advisor before buying any stock in the companies mentioned in this analysis. Beth Kindig and the I/O Fund own shares in NVDA at the time of writing and may own stocks pictured in the charts.

Damien Robbins, Equity Analyst at I/O Fund contributed to this analysis.

👉🏻 Share with a Fellow Investor
Help someone else benefit from this insight.

Recommended Reading:

About the author

Beth Kindig

Beth Kindig

Profile

Beth Kindig is the Founder, CEO and Lead Technology Analyst at I/O Fund, with more than 15 years of experience covering private and public technology companies. Known for her early Nvidia research beginning in 2018 and bold, high-conviction calls on emerging technology trends, Beth also manages I/O Fund's audited technology portfolio, which has returned 326% since May 2020, or 29.2% annualized. She is a regular guest on Fox Business and Bloomberg and has appeared on CNBC.

Curation

Expand your knowledge

View all posts
Google’s $250 Billion AI Chip Opportunity Takes Aim at Nvidia
AI PLATFORMS

Google’s $250 Billion AI Chip Opportunity Takes Aim at Nvidia

In April, there was a major shift in the AI accelerator market, and for once, it didn’t come from Nvidia. Six months later, merchant TPUs are moving from announcement to commercial execution, with Google recognizing its first revenue from TPU systems in Q2 (from a small base). Last quarter, Cloud revenue growth accelerated to 82% for $24.8 billion, compared to $22.5 billion expected. In addition, new details around the TPU 8t show that Google’s threat to Nvidia is not limited to inference. At the time, we pointed out that Google may be one of Nvidia’s strongest AI challengers, as Big Tech is closest to the problems that accelerators must solve. The problem that Google is prioritizing is lower cost per token, with token economics becoming a predominant concern as AI spending is pushing Big Tech’s free cash flows into the red. Below, we discuss two reasons why Google’s AI story is about to change, not from advancements in AI software, but by going after one of the most profitable hardware businesses the tech industry has ever seen.

AI PLATFORMSOCT 23, 2026
AI Debt Nears $500 Billion in 2026: What It Means for Nvidia, Oracle, CoreWeave and AI Stocks
AI STOCKS

AI Debt Nears $500 Billion in 2026: What It Means for Nvidia, Oracle, CoreWeave and AI Stocks

AI-related debt reached $466 billion through September 2026, more than four times last year’s pace. We break down who is borrowing, the three ways new AI chip deals are being structured, and where interest costs land across Nvidia, Oracle, CoreWeave, Broadcom and Big Tech.

AI STOCKSOCT 23, 2026
How Much Nvidia Business Does Microsoft’s Maia 300 AI Chip Really Replace?
AI PLATFORMS

How Much Nvidia Business Does Microsoft’s Maia 300 AI Chip Really Replace?

Microsoft’s Maia 300 is its “biggest bet yet” on its own silicon, but the details tell a narrower story than the headlines. The chip covers inference for Microsoft’s own products from 2027, about 10% of its AI chip spending by early 2027, and leaves Nvidia’s training and cloud business in place.

AI PLATFORMSOCT 23, 2026