BTC $81,207.73 -0.25%
ETH $2,394.15 +0.44%
BNB $741.20 +1.43%
XRP $1.30 -0.40%
SOL $103.61 +0.04%
TRX $0.3298 +0.58%
DOGE $0.0790 +0.46%
ADA $0.2132 +0.27%
BCH $283.31 +3.43%
LINK $11.91 -0.61%
HYPE $77.17 -0.60%
AAVE $146.24 -0.45%
SUI $0.9722 -0.45%
XLM $0.1746 -0.91%
ZEC $1,224.85 +0.77%
AAPL $347.90 -0.17%
AMZN $248.39 -0.82%
GOOGL $320.72 -1.15%
MSFT $524.79 +0.60%
META $644.16 -0.78%
NVDA $211.40 -0.40%
TSLA $372.98 -1.03%
SNDK $1,239.26 -1.72%
INTC $86.88 +1.46%
SPCX $147.47 +2.20%
MU $877.01 +2.21%
AMD $516.61 +1.59%
BTC $81,207.73 -0.25%
ETH $2,394.15 +0.44%
BNB $741.20 +1.43%
XRP $1.30 -0.40%
SOL $103.61 +0.04%
TRX $0.3298 +0.58%
DOGE $0.0790 +0.46%
ADA $0.2132 +0.27%
BCH $283.31 +3.43%
LINK $11.91 -0.61%
HYPE $77.17 -0.60%
AAVE $146.24 -0.45%
SUI $0.9722 -0.45%
XLM $0.1746 -0.91%
ZEC $1,224.85 +0.77%
AAPL $347.90 -0.17%
AMZN $248.39 -0.82%
GOOGL $320.72 -1.15%
MSFT $524.79 +0.60%
META $644.16 -0.78%
NVDA $211.40 -0.40%
TSLA $372.98 -1.03%
SNDK $1,239.26 -1.72%
INTC $86.88 +1.46%
SPCX $147.47 +2.20%
MU $877.01 +2.21%
AMD $516.61 +1.59%

Vitalik 分享本地私有 LLM 方案,强调隐私与安全优先

2026-04-02 14:53:42

ChainCatcher 消息,Vitalik Buterin 发文分享其截至 2026 年 4 月的本地化、私有化 LLM 部署方案,核心目标是将隐私、安全与自主可控作为前提,尽量减少远程模型及外部服务接触个人数据的机会,并通过本地推理、文件本地存储及沙箱隔离等方式降低数据泄露、模型越狱及恶意内容利用风险。

在硬件方面,其测试了搭载 NVIDIA 5090 GPU 的笔记本、AMD Ryzen AI Max Pro 128 GB 统一内存设备及 DGX Spark 等方案,并使用 Qwen3.5 35B 与 122B 模型进行本地推理。

其中,5090 笔记本在 35B 模型下可达约 90 tokens/s,AMD 方案约 51 tokens/s,DGX Spark 约 60 tokens/s。Vitalik 表示,其更倾向于基于高性能笔记本构建本地 AI 环境,同时使用 llama-server、llama-swap 及 NixOS 等工具搭建整体工作流。

app_icon
ChainCatcher 与创新者共建Web3世界