Skip to main content

Market Trends

2024 Trend: Memory and PC Rebound

Written by

Beth Kindig

Founder, CEO and Lead Technology Analyst

Published: November 17, 2023

Last Updated: November 17, 2023

If 2023 was the year AI accelerators made their importance known, then 2024 will be the year that memory and HBM3/HBM3E makes its importance known as the competition is going head-to-head at memory capacity and bandwidth per GPU rather than compute performance. This further translates to mean the AI race is more focused on inference for the next generation of GPUs as the neural network can be run entirely in memory without the need to move data back-and-forth with the external memory. Similar to the memory and smartphone markets, the PC market is in the process of normalizing inventory. Silicon Motion, one of the largest manufacturers of NAND flash controllers, which go into PCs and smartphones, commented in its recent earnings call that inventory for the PC and smartphone markets is normalizing and these markets are poised to return to growth in CY24.

Pro members

Sign in to read the full article

Sign in with your I/O Fund account to check your plan access.

Curation

Expand your knowledge

View all posts
Beyond Hyperscalers: Here’s the Next $1 Trillion AI Infrastructure Opportunity
AI STOCKS

Beyond Hyperscalers: Here’s the Next $1 Trillion AI Infrastructure Opportunity

Since 2022, Big Tech capex has been the clearest barometer of AI demand. But the market’s reaction to Google’s latest earnings shows investors are questioning how long that spending can last. While the market frets over hyperscalers’ cash flows, a second wave of AI infrastructure spending has quietly emerged, driven by enterprises and neocloud customers.

AI STOCKSOCT 30, 2026
Google’s $250 Billion AI Chip Opportunity Takes Aim at Nvidia
AI PLATFORMS

Google’s $250 Billion AI Chip Opportunity Takes Aim at Nvidia

In April, there was a major shift in the AI accelerator market, and for once, it didn’t come from Nvidia. Six months later, merchant TPUs are moving from announcement to commercial execution, with Google recognizing its first revenue from TPU systems in Q2 (from a small base). Last quarter, Cloud revenue growth accelerated to 82% for $24.8 billion, compared to $22.5 billion expected. In addition, new details around the TPU 8t show that Google’s threat to Nvidia is not limited to inference. At the time, we pointed out that Google may be one of Nvidia’s strongest AI challengers, as Big Tech is closest to the problems that accelerators must solve. The problem that Google is prioritizing is lower cost per token, with token economics becoming a predominant concern as AI spending is pushing Big Tech’s free cash flows into the red. Below, we discuss two reasons why Google’s AI story is about to change, not from advancements in AI software, but by going after one of the most profitable hardware businesses the tech industry has ever seen.

AI PLATFORMSOCT 23, 2026
AI Debt Nears $500 Billion in 2026: What It Means for Nvidia, Oracle, CoreWeave and AI Stocks
AI STOCKS

AI Debt Nears $500 Billion in 2026: What It Means for Nvidia, Oracle, CoreWeave and AI Stocks

AI-related debt reached $466 billion through September 2026, more than four times last year’s pace. We break down who is borrowing, the three ways new AI chip deals are being structured, and where interest costs land across Nvidia, Oracle, CoreWeave, Broadcom and Big Tech.

AI STOCKSOCT 23, 2026