BTC $81,378.31 +0.29%
ETH $2,400.39 +0.93%
BNB $742.29 +1.84%
XRP $1.31 +1.00%
SOL $103.82 +0.80%
TRX $0.3299 +0.70%
DOGE $0.0792 +1.46%
ADA $0.2141 +1.84%
BCH $283.99 +4.16%
LINK $11.95 +0.78%
HYPE $77.72 +0.99%
AAVE $147.29 +0.96%
SUI $0.9766 +0.80%
XLM $0.1752 +0.25%
ZEC $1,233.40 +2.26%
AAPL $347.49 -0.26%
AMZN $248.81 -0.87%
GOOGL $321.95 -0.88%
MSFT $525.09 +0.56%
META $641.65 -0.71%
NVDA $211.65 -0.38%
TSLA $372.48 -0.26%
SNDK $1,243.08 +0.54%
INTC $87.12 +2.53%
SPCX $147.96 +1.61%
MU $881.11 +3.76%
AMD $518.12 +2.25%
BTC $81,378.31 +0.29%
ETH $2,400.39 +0.93%
BNB $742.29 +1.84%
XRP $1.31 +1.00%
SOL $103.82 +0.80%
TRX $0.3299 +0.70%
DOGE $0.0792 +1.46%
ADA $0.2141 +1.84%
BCH $283.99 +4.16%
LINK $11.95 +0.78%
HYPE $77.72 +0.99%
AAVE $147.29 +0.96%
SUI $0.9766 +0.80%
XLM $0.1752 +0.25%
ZEC $1,233.40 +2.26%
AAPL $347.49 -0.26%
AMZN $248.81 -0.87%
GOOGL $321.95 -0.88%
MSFT $525.09 +0.56%
META $641.65 -0.71%
NVDA $211.65 -0.38%
TSLA $372.48 -0.26%
SNDK $1,243.08 +0.54%
INTC $87.12 +2.53%
SPCX $147.96 +1.61%
MU $881.11 +3.76%
AMD $518.12 +2.25%

DeepSeek 开源并发布 3FS,高速并行文件系统优化 AI 数据访问

2025-02-28 09:15:15

ChainCatcher 消息,据 DeepSeek 公告,在开源周第五天,其 Fire-Flyer 文件系统(3FS)正式开源,作为一款高性能并行文件系统,3FS 可充分利用现代 SSD 和 RDMA 网络,实现高速数据访问,提升 AI 模型训练与推理效率。

3FS关键性能指标:

  • 在 180 节点集群中实现 6.6 TiB/s 总读取吞吐量
  • 在 25 节点 GraySort 基准测试中达到 3.66 TiB/分钟吞吐量
  • 单节点 KVCache 查询峰值吞吐量超 40+ GiB/s

3FS采用分离式架构,支持数据预处理、数据集加载、检查点存储/恢复、嵌入向量搜索及推理 KVCache 查询,具备强一致性语义。DeepSeek 同步推出 Smallpond 数据处理框架,进一步优化 3FS 数据管理能力。

app_icon
ChainCatcher 与创新者共建Web3世界