www.techspot.com
What just happened? In response to Western organizations calling it "shady and untrustworthy," DeepSeek launched "Open Source Week." During last week's event, the company released several repositories to the open-source community, including a highly efficient file system. Many AI specialists reviewing the code have come away impressed. Last week, DeepSeek released five of its most advanced software repositories during its "Open Source Week" event. The Chinese AI firm unveiled a Linux-based file system it uses internally for AI training and inference workloads. The Fire-Flyer File System (3FS) boasts some impressive performance benchmarks. Western AI companies have taken note and are exploring the repos. The company designed 3FS to accelerate AI tasks. The technology leverages the features of modern solid-state storage units and RDMA networks, providing a shared storage layer to simplify the deployment of distributed applications.Tom's Harware notes that DeepSeek's 3FS code works without read caching and prioritizes random read requests since AI models running on GPU nodes constantly access data snippets stored on servers. The file system can combine the throughput of thousands of SSD units and the network bandwidth of hundreds of storage nodes, simplifying application code and applying standard storage API models.The distributed file system can reach a 6.6 TiB/s aggregate read throughput when used in a 180-node cluster, achieving a 3.66 TiB/min throughput on the GraySort benchmark (in a 25-node cluster). Startup company Perspective AI praised DeepSeek's figures as some "next-level" benchmarks, describing 3FS as a potential revolution for data-heavy workloads related to AI, research, and more.In a paper published last summer, DeepSeek researchers described the features of the company's custom Fire-Flyer 2 AI high-performance computing architecture. Thanks to 3FS, HaiScale, and other elements of its software stack, DeepSeek achieved 80 percent of the performance of Nvidia's DGX-A100 servers at 50 percent of the price and using 40 percent less energy. Fire-Flyer 2 used 180 storage nodes with 16 16TB SSDs each, two 200Gbps NUCs, and 10,000 Nvidia A100 GPUs over PCIe. // Related StoriesDeepSeek created Open Source Week to emphasize its transparency and community-based innovation after being criticized as shadowy and untrustworthy. The Chinese company is releasing many software products as open-source repositories, with key targets including FlashMLA, DeepEP, DeepGEMM, and more.
0 Commenti ·0 condivisioni ·47 Views