Post Syndicated from Patrick Kennedy original https://www.servethehome.com/supermicro-ars-111gl-nhr-nvidia-gh200-grace-hopper-1u-server-review-arm/
We review the Supermicro ARS-111GL-NHR, a 1U air-cooled NVIDIA GH200 server, and show why Grace Hopper is super cool
The post Supermicro ARS-111GL-NHR NVIDIA GH200 Grace Hopper 1U Server Review appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/the-intel-xeon-6-r1s-is-a-single-socket-special/
The Intel Xeon 6 R1S offering will offer a Granite Rapids P-core single-socket platform with 136 lanes of PCIe Gen5
The post The Intel Xeon 6 R1S is a Single Socket Special appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/a-quick-introduction-to-the-nvidia-gh200-aka-grace-hopper-arm/
The NVIDIA GH200 or “Grace Hopper” is far from a single product. We have a quick guide so when someone says “GH200” you know what to look for
The post A Quick Introduction to the NVIDIA GH200 aka Grace Hopper appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/sth-weekly-newsletters-you-want-to-subscribe-in-q3-2024/
Subscribe to our newsletters to stay up to date on the latest reviews and coverage from STH and more delivered to your inbox
The post STH Weekly Newsletters You Want to Subscribe in Q3 2024 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/farewell-to-anandtech-after-over-27-years/
Today marks the end of a 27 plus year journey for what was one of the best technology sites the world has ever seen
The post Farewell to AnandTech After Over 27 Years appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/mlperf-inference-v4-1-nvidia-b200-whallops-amd-mi300x-untetherai-rises/
In MLPerf Inference v4.1 the upcoming NVIDIA B200 whalloped the current AMD MI300X but UntetherAI submitted some excellent efficiency runs
The post MLPerf Inference v4.1 NVIDIA B200 Whallops AMD MI300X UntetherAI Rises appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/microsoft-maia-100-ai-accelerator-for-azure/
We learned more about the Microsoft Maia 100 which is the company’s AI accelerator to run OpenAI models at lower costs
The post Microsoft MAIA 100 AI Accelerator for Azure appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/ampere-ampereone-at-hot-chips-2024-arm/
At Hot Chips 2024, Ampere went into the AmpereOne microarchitecture details and discussed how it designed and built its custom Arm processor
The post Ampere AmpereOne Architecture at Hot Chips 2024 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/xiangshan-high-performance-risc-v-processors-at-hot-chips-2024/
The XiangShan RISC-V CPU project from Chinese universities is designing and delivering cores targeting Arm Neoverse N2 and Cortex A76 designs
The post XiangShan High-Performance RISC-V Processors at Hot Chips 2024 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/cerebras-enters-ai-inference-blows-away-tiny-nvidia-h100-gpus-by-besting-hbm/
Cerebras enters AI inference and uses its giant chip to run circles around NVIDIA HGX H100 platform performance
The post Cerebras Enters AI Inference Blows Away Tiny NVIDIA H100 GPUs by Besting HBM appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/intel-4tbps-optical-chiplet-for-xpu-to-xpu-connectivity-detailed/
At Hot Chips 2024 Intel showed off a 4Tbps optical chiplet to displace copper chip-to-chip links with longer reach efficient optics
The post Intel 4Tbps Optical Chiplet for XPU to XPU Connectivity Detailed appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/enfabrica-acf-s-a-huge-multi-tbps-supernic-at-hot-chips-2024/
The Enfabrica ACF-S takes aspects of scale-up and scale-up combining up to 3.2Tbps of networking and 10x PCIe Gen5 x16 links into one chip
The post Enfabrica ACF-S A HUGE Multi-Tbps SuperNIC at Hot Chips 2024 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/tesla-dojo-exa-scale-lossy-ai-network-using-the-tesla-transport-protocol-over-ethernet-ttpoe/
Tesla brought its Dojo V1 networking hardware to Hot Chips 2024 and announced that it is donating its own TTPoE protocol to the Ultra Ethernet Consortium
The post Tesla DOJO Exa-Scale Lossy AI Network using the Tesla Transport Protocol over Ethernet TTPoE appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/meta-ai-acceleration-in-the-next-gen-meta-mtia-for-recommendation-inference-risc-v/
The next-gen Meta MTIA is a custom RISC-V accelerator for the company’s recommendation model AI inference workloads deployed this year
The post Meta AI Acceleration in the Next-Gen Meta MTIA for Recommendation Inference appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/amd-versal-ai-edge-arm-series-gen-2-for-vision-and-autos/
The AMD Versal AI Edge Series Gen 2 is the update to the 2021 series of chips for automotive and edge inference applications
The post AMD Versal AI Edge Series Gen 2 for Vision and Autos appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/broadcom-ai-compute-asic-with-optical-attach-detailed-at-hot-chips-2024/
In one of the coolest presentations at Hot Chips 2024 so far, Broadcom showed co-packaged silicon photonics for switches and AI ASICs
The post Broadcom AI Compute ASIC with Optical Attach Detailed at Hot Chips 2024 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/furiosaai-rngd-processor-for-sustainable-ai-compute/
The FuriosaAI RNGD processor was detailed and shown at Hot Chips 2024 for lower power AI inference applications
The post FuriosaAI RNGD Processor for Sustainable AI Compute appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/amd-instinct-mi300x-architecture-at-hot-chips-2024/
AMD had a talk on its big AI GPU at Hot Chips 2024. The AMD Instinct MI300X is a multi-billion dollar product line for the company
The post AMD Instinct MI300X Architecture at Hot Chips 2024 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/intel-gaudi-3-for-ai-training-and-inference/
We have more details of the Intel Gaudi 3 for AI training and inference at Hot Chips 2024 including generational performance gains
The post Intel Gaudi 3 for AI Training and Inference appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/sambanova-sn40l-rdu-for-trillion-parameter-ai-models/
This is the SambaNova SN40L a dataflow architecture AI accelerator with 520MB of SRAM, 64GB of HBM, and 1.5TB of DDR memory
The post SambaNova SN40L RDU for Trillion Parameter AI Models appeared first on ServeTheHome.