Post Syndicated from Patrick Kennedy original https://www.servethehome.com/intel-gaudi-3-24x-200gbe-ai-accelerator-short-video/
We have a quick 30 second video on the Intel Gaudi 3 AI accelerator that uses 24x 200GbE connections to scale to eight AI modules and beyond
The post Intel Gaudi 3 24x 200GbE AI Accelerator The Short Video appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/this-is-intel-gaudi-3-the-new-128gb-hbm2e-ai-chip-in-the-wild-intel-vision-2024/
This is Intel Gaudi 3 from Intel Vision 2024. The new modules are designed for scale-out AI inference and training with 24x 200GbE links
The post This is Intel Gaudi 3 the New 128GB HBM2e AI Chip in the Wild appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/new-meta-ai-accelerator-mtia-2-revealed/
The new Meta MTIA 2 AI accelerator optimizes for memory capacity/ W or memory capacity/ compute unit making it a very different AI design
The post New Meta AI Accelerator MTIA 2 Revealed appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/nvidia-gtc-2024-keynote-coverage-new-cpus-gpus-and-more/
We are covering the NVIDIA GTC 2024 keynote live from San Jose California with tons of new product launches from the AI company
The post NVIDIA GTC 2024 Keynote Coverage New CPUs GPUs and More appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/cerebras-wse-3-ai-chip-launched-56x-larger-than-nvidia-h100-vertiv-supermicro-hpe-qualcomm/
The Cerebras WSE-3 is a giant AI training engineering marvel with 44GB of on-chip memory, 900,000 cores, and 125PF of AI compute
The post Cerebras WSE-3 AI Chip Launched 56x Larger than NVIDIA H100 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/amd-infinity-fabric-afl-scale-up-competitor-to-nvidia-nvlink-coming-to-broadcom-switches-in-pcie-gen7/
AMD’s AFL Infinity Fabric scale-up competitor to NVIDIA NVLink is coming to Broadcom switches in the PCIe Gen7 era
The post AMD Infinity Fabric AFL Scale Up Competitor to NVIDIA NVLink Coming to Broadcom Switches in PCIe Gen7 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/nvidia-l40s-vs-h100-vs-a100-the-video/
We have a video on the NIVIDA L40S vs NVIDIA H100 vs NVIDIA A100 and why the new L40S is a different GPU option for AI inference and more
The post NVIDIA L40S vs H100 vs A100 The Video appeared first on ServeTheHome.
Post Syndicated from John Lee original https://www.servethehome.com/touring-the-ai-servers-at-the-asus-sc23-booth-nvidia/
We tour the NVIDIA AI servers in the ASUS SC23 booth. This includes HGX H100 platforms, L40S platforms, and a special liquid cooling option
The post Touring the NVIDIA AI Servers at the ASUS SC23 Booth appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/marvell-octeon-cn103-dpu-50gbps-encryption-on-one-core-arm/
We saw a demo of the new Marvell Octeon 10 DPU. The demo had two Marvell CN103 DPUs in new low profile PCIe cards offloading IPsec crypto
The post Marvell Octeon CN103 DPU 50Gbps Encryption on One Core appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/google-tpu-v5p-ai-chip-launches-alongside-gemini/
The Google TPU v5p scales to pods of up to 8960 chips with huge interconnect bandwidth. This is a chip used to train Gemini
The post Google TPU v5p AI Chip Launches Alongside Gemini appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/amd-instinct-mi300x-gpu-and-mi300a-apus-launched-for-ai-era/
We delve into the new AMD Instinct MI300X GPU, MI300A APU, and see how AMD has built packages to go head-to-head with the NVIDIA H100 and win
The post AMD Instinct MI300X GPU and MI300A APUs Launched for AI Era appeared first on ServeTheHome.
Post Syndicated from Cliff Robinson original https://www.servethehome.com/aws-graviton4-is-an-even-bigger-arm-server-processor-and-tranium2-for-ai-nvidia/
Today AWS made the much-anticipated announcement of Graviton4 which should be available in 2024. This is AWS’s latest Graviton processor and the fourth generation launched in the last five years. The company also announced its second-generation Tranium2 processor for AI workloads. AWS Graviton4 is an Even Bigger Arm Server Processor AWS is continuing on its […]
The post AWS Graviton4 is an Even Bigger Arm Server Processor and Tranium2 for AI appeared first on ServeTheHome.
Post Syndicated from John Lee original https://www.servethehome.com/neuchips-recaccel-n3000-ai-inference-accelerator-at-sc23/
We saw the Neuchips RecAccel N3000 AI inference accelerator at SC23 with up to four accelerators and 256GB of memory per card
The post Neuchips RecAccel N3000 AI Inference Accelerator at SC23 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/giagantic-amd-apu-at-sc23-meet-the-amd-mi300a-and-mi300x/
We saw the AMD Instinct MI300A (giant APU) and MI300X (GPU) at SC23 and learned a few new things about AMD’s new AI and HPC platforms
The post Giagantic AMD APU at SC23 Meet the AMD MI300A and MI300X appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/intel-shows-gpu-max-1550-performance-and-gaudi3-ai-updates-at-sc23/
Intel showed its GPU Max 1550 series at SC23 but it also expects to have a 144GB class Gaudi3 AI accelerator in 2024 like NVIDIA
The post Intel Shows GPU Max 1550 Performance and Gaudi3 AI Updates at SC23 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/nvidia-h200-launched-with-141gb-of-hbm3e-at-sc23/
A new NVIDIA H200 141 GB module is out offering more capacity and bandwidth, but also as one of the more restrained refreshes for NVIDIA
The post NVIDIA H200 Launched with 141GB of HBM3e at SC23 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/nvidia-shows-intel-gaudi2-is-4x-better-performance-per-dollar-than-its-h100/
In a stunning twist, NVIDIA shows the Intel Gaudi2 is roughly 4x better performance per dollar than the H100 in its MLPerf Training results
The post NVIDIA Shows Intel Gaudi2 is 4x Better Performance Per Dollar than its H100 appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/touring-the-intel-ai-playground-inside-the-intel-developer-cloud/
We tour Intel’s AI playground as we get inside the Intel Developer Cloud’s Oregon location to show hardware being made available to developers
The post Touring the Intel AI Playground – Inside the Intel Developer Cloud appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/nvidia-l40s-is-the-nvidia-h100-ai-alternative-with-a-big-benefit-supermicro/
We delve into the NVIDIA L40S versus the NVIDIA H100 PCIe and discuss the differences and why the L40S should be the go-to GPU for many today
The post NVIDIA L40S is the NVIDIA H100 AI Alternative with a Big Benefit appeared first on ServeTheHome.
Post Syndicated from Patrick Kennedy original https://www.servethehome.com/sk-hynix-hbm3e-cxl-computational-memory-mcrdimm-and-more-ocp-summit-2023/
At OCP Summit 2023, we saw SK hynix HBM3e, CXL Computational Memory, MCRDIMM for 2024, PCIe Gen5 NVMe SSDs, and Accelerator in Memory modules
The post SK hynix HBM3e CXL Computational Memory MCRDIMM and More OCP Summit 2023 appeared first on ServeTheHome.
By continuing to use the site, you agree to the use of cookies. more information
The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.