Whatever your approach to AI development, you’ll be more than a little concerned by the spiraling costs of tokens. Analysis ...

GLM-5.3-Flash, the AI model Z.ai previewed anonymously as Ox Alpha, ran on 100,000 Chinese chips during its launch week ...

Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt ...

Cerebras Systems (NASDAQ:CBRS) outlined a product roadmap centered on faster AI inference, expanded data-center capacity and ...

The pilot stage is the best time to consider the implications of architecture, security, and operations for running AI ...

Broadcom and Micron both posted blowout quarters riding the same AI wave, yet they operate from almost opposite ends of the ...

The Toronto-based startup, founded in 2023, has raised $219 million and builds chips hardwired for specific AI models ...

Already the winner in AI model training, Nvidia now has its sights on the inference market. The company's big move to capture share was its "acquisition" of Groq and its language processing units ...

As agents reason, replan, call other agents, and work continuously in the background, Gartner predicts inference costs per workflow will rise more than fivefold through 2028.

Nvidia CEO Jensen Huang unveils a high-speed AI inference system using Groq technology, targeting growing demand.

General Compute, an AI inference cloud startup, has landed a $400 million loan from Upper90, a tech investment firm. It might be the first deal to put up inference-specific chips as collateral — chips ...

The QCT business is Qualcomm's bread and butter, generating 86% of its revenue in the second quarter of fiscal 2026 (which ended March 29). The company's QCT revenue fell 4% year over year in fiscal ...