Post Syndicated from Ryan Smith original https://www.servethehome.com/googles-tpuv8s-for-training-and-inference-at-hot-chips-2026/
Hot Chips 2026 sees Google discussing its new eighth-generation TPU family for the technical crowd. One of the only hyperscalers to develop its own training hardware, the company has developed the TPU 8t for training, as well as the TPU 8i for inference
The post Google’s TPUv8s for Training and Inference at Hot Chips 2026 appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/qualcomm-modular-amd-open-sourced-at-modcon-2026/
Qualcomm’s Modular software is now open-source as a big announcement from ModCon 2026 and an unexpected guest made an appearance
The post Qualcomm Modular Open-Sourced at ModCon 2026 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/google-tpu-8i-for-inference-and-tpu-8t-for-training-announced/
Today we got a glimpse of Google TPU 8i and TPU 8t designed specifically for the company’s AI inference and training compute
The post Google TPU 8i for Inference and TPU 8t for Training Announced appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/this-is-the-google-tpu-v7-ironwood-chip/
At SC25, we saw the Google TPU v7 Ironwood generation package on the show floor and took some photos of Google’s AI chip
The post This is the Google TPU v7 Ironwood Chip appeared first on ServeTheHome.
Post Syndicated from Ryan Smith original https://www.servethehome.com/googles-ironwood-tpu-swings-for-reasoning-model-leadership-at-hot-chips-2025/
Closing out the machine learning sessions at Hot Chips 2025 is Google, who is at the show to talk about their latest tensor processing unit (TPU), codenamed Ironwood. Revealed by the company a few months ago, Ironwood is the first Google TPU that is explicitly designed for large-scale AI inference (rather than AI training). Paired […]
The post Google’s Ironwood TPU Swings for Reasoning Model Leadership at Hot Chips 2025 appeared first on ServeTheHome.
Post Syndicated from Eric Smith original https://www.servethehome.com/google-cloud-tpu-v6e-trillium-shown-at-sc24/
At SC24, we saw the Google Cloud TPU v6e Trillium. This is Google’s custom AI accelerator with more performance, interconnect, and memory
The post Google Cloud TPU v6e Trillium Shown at SC24 appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/unigen-biscotti-dual-hailo-8-ai-module-spotted-in-aic-booth-at-computex-2024/
At Computex 2024, we saw the Unigen Biscotti, a low-power dual Hailo-8 AI inference accelerator E1.S card in the AIC booth
The post Unigen Biscotti Dual Hailo-8 AI Module Spotted in AIC Booth at Computex 2024 appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/google-tpu-v5p-ai-chip-launches-alongside-gemini/
The Google TPU v5p scales to pods of up to 8960 chips with huge interconnect bandwidth. This is a chip used to train Gemini
The post Google TPU v5p AI Chip Launches Alongside Gemini appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/google-brings-tpu-v5e-ai-board-to-sc23/
Google brought its TPU v5e AI board to SC23 being watched over by a security guard so that attendees can see its AI powerhouse chip
The post Google Brings TPU v5e AI Board to SC23 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/nvidia-shows-intel-gaudi2-is-4x-better-performance-per-dollar-than-its-h100/
In a stunning twist, NVIDIA shows the Intel Gaudi2 is roughly 4x better performance per dollar than the H100 in its MLPerf Training results
The post NVIDIA Shows Intel Gaudi2 is 4x Better Performance Per Dollar than its H100 appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/mlperf-inference-v3-1-shows-nvidia-grace-hopper-and-a-cool-amd-tpu-v5e-win/
NVIDIA’s MLPerf Inference v3.1 is out. Two standouts were NVIDIA setting the stage to jettison x86 and AMD having a big win at Google
The post MLPerf Inference v3.1 Shows NVIDIA Grace Hopper and a Cool AMD TPU v5e Win appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/google-details-tpuv4-and-its-crazy-optically-reconfigurable-ai-network/
Google detailed how its TPUv4 pods use optically reconfigurable networks to support efficient, large scale, AI workloads
The post Google Details TPUv4 and its Crazy Optically Reconfigurable AI Network appeared first on ServeTheHome.