TMCnet

Quadric, Inference Engine for On-Device AI Chips, Raises $30M Series C as Design Wins Accelerate Across Edge LLMs, Automotive, and Enterprise

BURLINGAME, Calif., Jan. 14, 2026 /PRNewswire/ -- Quadric ®, the inference engine that powers on-device AI chips, today ...
Semiconductor Engineering

GDDR7 Momentum Accelerates As A Key Solution For AI Inference

The AI hardware landscape continues to evolve at a breakneck speed, and memory technology is rapidly becoming a defining ...
Guru3D

AMD Details Single-Node and Distributed Inference Performance on Instinct MI355X

AMD has published new technical details outlining how its AMD Instinct MI355X accelerator addresses the growing inference ...
Seeking Alpha

SHARON AI Launches Major Upgrade to its AI Platform, including Inference Engine for Enterprise

SHARON AI Platform capabilities are expansive for developer, research, enterprise, and government customers, including enterprise-grade RAG and Inference engines, all powered by SHARON AI in a single ...
The Next Platform

Cerebras Inks Transformative $10 Billion Inference Deal With OpenAI

If GenAI is going to go mainstream and not just be a bubble that helps prop up the global economy for a couple of years, AI ...
Business Wire

Predibase Launches Next-Gen Inference Stack for Faster, Cost-Effective Small Language Model Serving

Predibase's Inference Engine Harnesses LoRAX, Turbo LoRA, and Autoscaling GPUs to 3-4x Throughput and Cut Costs by Over 50% While Ensuring Reliability for High Volume Enterprise Workloads. SAN ...
Business Wire

RunPod Partners with vLLM to Accelerate AI Inference

MOUNT LAUREL, N.J.--(BUSINESS WIRE)--RunPod, a leading cloud computing platform for AI and machine learning workloads, is excited to announce its partnership with vLLM, a top open-source inference ...
Seeking Alpha

NTT Announces AI Inference Chip for Real-Time 4K Video Processing

NTT unveils AI inference LSI that enables real-time AI inference processing from ultra-high-definition video on edge devices and terminals with strict power constraints. Utilizes NTT-created AI ...
La Grande Observer

GMI Cloud Announces Cost-Effective High Performance AI Inference Engine at Scale

SAN JOSE, Calif., March 26, 2025 /PRNewswire/ — GMI Cloud, a leading AI-native GPU cloud provider, today announced its Inference Engine which ensures businesses can unlock the full potential of their ...
Semiconductor Engineering

What’s The Best Way To Sell An Inference Engine?

The burgeoning AI market has seen innumerable startups funded on the strength of their ideas about building faster, lower-power, and/or lower-cost AI inference engines. Part of the go-to-market ...
Barron's

Nvidia Announces New Inference Engine Called Dynamo

Inference, what happens after you prompt an AI model like ChatGPT, has taken on more salience now that traditional model scaling has stalled. To get better responses, model makers like OpenAI and ...
EDN

NTT develops AI inference chip for 4K video processing

At its Upgrade 2025 annual research and innovation summit, NTT Corporation (NTT) unveiled an AI inference large-scale integration (LSI) for the real-time processing of ultra-high-definition (UHD) ...