DeepSeek open-sources and releases 3FS, a high-speed parallel file system that optimizes AI data access

PANews reported on February 28 that according to DeepSeek’s announcement, on the fifth day of Open Source Week, its Fire-Flyer file system (3FS) was officially open sourced. As a high-performance parallel file system, 3FS can make full use of modern SSDs and RDMA networks to achieve high-speed data access and improve the efficiency of AI model training and reasoning.

3FS Key Performance Indicators:

Achieved 6.6 TiB/s total read throughput in a 180-node cluster;

Achieved 3.66 TiB/minute throughput on a 25-node GraySort benchmark;

The peak query throughput of a single-node KVCache exceeds 40+ GiB/s.

3FS adopts a separate architecture, supports data preprocessing, data set loading, checkpoint storage/recovery, embedded vector search and reasoning KVCache query, and has strong consistency semantics. DeepSeek simultaneously launched the Smallpond data processing framework to further optimize 3FS data management capabilities.

Share to:

Author: PA一线

This content is for informational purposes only and does not constitute investment advice.

Follow PANews official accounts, navigate bull and bear markets together
Recommended Reading
41 minute ago
2 hour ago
3 hour ago
4 hour ago
7 hour ago
8 hour ago

Popular Articles

Industry News
Market Trends
Curated Readings

Curated Series

App内阅读