Groq Secures $650M Funding to Scale AI Inference Cloud

Groq, the artificial intelligence chip developer, has secured $650 million in a fresh funding round, marking a significant move to accelerate its “neocloud” business. The capital injection comes just months after a complex deal with Nvidia that saw the GPU giant license Groq’s intellectual property and recruit key leadership figures.

The latest investment was spearheaded by the Dallas-based firm Disruptive, led by Groq chairman Alex Davis, alongside the Fort Lauderdale hedge fund Infinitum. While the company did not disclose its current valuation, it was previously valued at $6.9 billion following a $750 million round in September.

A Strategic Pivot to Cloud Services

The company’s shift follows a turbulent period that began in December, when Nvidia signed a non-exclusive licensing agreement for Groq’s technology. That arrangement included the departure of Groq’s founder and CEO, Jonathan Ross—a former Google engineer known for his work on the Tensor Processing Unit—and president Sunny Madra. Doug Wightman, who co-founded Groq with Ross a decade ago, has since stepped into the CEO role.

With Nvidia now incorporating the Language Processing Unit (LPU) technology into its own Nvidia Groq 3 LPX hardware system, Groq has realigned its focus. The firm is now doubling down on its “neocloud” infrastructure, an initiative previously managed by Madra following the 2024 acquisition of his data analytics startup, Definitive Intelligence.

Operational Expansion and New Leadership

Groq reports that its cloud platform currently supports over five million developers and thousands of AI enterprises. The infrastructure spans 13 data centers across North America, Europe, the Middle East, and the Asia-Pacific region, processing trillions of tokens weekly.

To support this growth, the company has overhauled its executive team:

• Alan Rice: Appointed as COO, bringing experience from xAI, Meta, and the U.S. Navy.
• Sinclair Schuller: Joins as CTO.
• Rakesh Malhotra: Joins as CPO, bringing a decade of experience from Microsoft’s cloud division.

Schuller and Malhotra previously collaborated at the software firm Nuvalence, which was acquired by EY in 2024, and at the enterprise cloud company Apprenda.

The Competitive Landscape of AI Inference

The long-term viability of Groq hinges on its ability to maintain a competitive edge in the inference market, even as its original hardware IP is utilized by a dominant rival. The sector remains a primary focus for venture capital, driven by the massive demand for efficient AI processing.

Industry precedents suggest that such transitions can lead to recovery. For instance, Scale AI CEO Jason Droege recently noted to Forbes that his company has seen significant growth following a $14.3 billion deal with Meta last year, projecting revenues to reach $1 billion. Whether Groq can replicate this trajectory remains to be seen as the company pivots toward its cloud-first future.

For more details on the company’s growth strategy, visit the official announcement.