www.techspot.com
TL;DR: AMD has published benchmarks that appear to suggest its Radeon RX 7900 XTX graphics card is significantly faster than Nvidia's RTX 4090 and RTX 4080 Super when it comes to DeepSeek R1 benchmarks. Team Red also released instructions for DIY enthusiasts to run the R1 on Ryzen AI CPUs and Radeon GPUs. According to an X post by David McAfee, the VP and GM of Ryzen CPU and Radeon graphics at AMD, the company tested the 7900 XTX against the RTX 4090 and RTX 4080 Super using DeepSeek R1, and the RDNA 3 GPU was between 13 percent and 34 percent faster than Nvidia hardware depending on the LLM and number of parameters.With seven billion parameters, the 7900 XTX trumped the RTX 4090 by 13 percent in Distill Qwen, while it was 11 percent faster in Distill Llama with eight billion parameters. With 14 billion parameters, the AMD card beat the Ada Lovelace flagship by two percent in Distill Qwen. However, when the number of parameters went up to 32 billion, the RTX 4090 had a four percent advantage over the RDNA 3 flagship in Distill Qwen.AMD also compared the 7900 XTX to the RTX 4080 Super, showing its card was faster in every test. The AMD product outperformed the Nvidia GPU by 34 percent using DeepSeek R1 Distill Qwen with seven billion parameters and 27 percent using Distill Llama with eight billion parameters. With the number of parameters increased to 14 billion, the card from Team Red was still 22 percent faster using Distill Qwen.In addition to the benchmarks, AMD also published detailed instructions on how to run DeepSeek locally on your PC. According to the company, all its RDNA 3 desktop GPUs are compatible with several LLMs using R1. Most of these models can also run on select Ryzen CPUs with XDNA NPUs.AMD also released a list of the maximum supported LLM parameters and provided instructions on how LM Studio's one-click installer can be tuned for its hardware. According to the company, the Radeon RX 7900 XTX supports up to 32 billion parameters, while the entry-level RX 7600, with its 8GB of VRAM, supports up to eight billion parameters in Distill Llama. // Related Stories
0 Reacties ·0 aandelen ·46 Views