AI startup General Compute has obtained a $400 million loan from Upper90, marking a shift toward financing inference-specific chips rather than traditional GPUs.
Key facts
- •General Compute raised a $15 million seed round in May to develop its inference-focused cloud infrastructure.
- •The company utilizes SambaNova’s SN50 chips, which are designed to be more power-efficient than standard GPUs.
- •Upper90 previously pioneered chip-backed financing in 2021 by providing loans to the data center startup Crusoe.
- •General Compute claims its new chips offer 16 times faster inference performance compared to GPU-based clouds.
- •The deal is viewed as a signal of market interest in alternatives to Nvidia's hardware ecosystem for AI inference.
General Compute, an AI inference cloud startup, has secured a $400 million loan from the investment firm Upper90. The deal is notable for using inference-specific chips as collateral, representing a move toward infrastructure designed to run pre-trained AI models efficiently. This financing arrangement aims to support the company’s efforts to provide cost-effective alternatives to the high-priced hardware typically used for building AI models.
By the numbers
Focus on Inference Infrastructure
General Compute, led by CEO Finn Puklowski, focuses on building an 'inference neocloud' using silicon from the chipmaker SambaNova. Unlike general-purpose infrastructure, these chips are designed specifically for inference tasks, offering power efficiency and eliminating the need for expensive water-cooling systems. The company claims its hardware can provide inference speeds 16 times faster than those found in GPU-based clouds.
Shifting Investment Strategies
Upper90’s investment reflects a broader market trend of seeking alternatives to Nvidia’s ecosystem. Upper90 CEO Billy Libby, who previously financed GPU purchases for the startup Crusoe in 2021, noted that the market for GPU-backed loans has matured since traditional lenders initially avoided the risks of hardware depreciation. With GPUs now widely understood, investors are increasingly looking toward inference-focused players to address the growing demand for running open-source models.
Market Implications
The deal signals a potential shift in capital allocation as the AI industry seeks to reduce reliance on Nvidia’s dominant market position. By utilizing chips from alternative manufacturers, companies like General Compute aim to improve the total cost of ownership for AI workloads. Puklowski described the partnership as a sign of capital organizing to support the fragmentation of Nvidia's market dominance, providing a path for scalable, high-performance chips that currently lack a broad buyer base.
Timeline
- 2021Upper90 financed GPU purchases for the startup Crusoe.
- MayGeneral Compute raised a $15 million seed round.
- This weekKimi’s K3 model demonstrated competitive performance against Anthropic and OpenAI on coding benchmarks.
Advertisement
This article was independently rewritten by ManyPress editorial AI from reporting originally published by TechCrunch.
