背景:把平台从「单机单进程」改造成「1 组 Manager + N 台 Worker + 共享归属状态」,
硬约束 = 全程兼容单例模式(deployMode 默认 local;生产切换前 47 一行未动)。
主要改动
1) 数据模型 v7(SQLite 与 PG 两方言同步):新增 dsh_hosts 注册表 +
dsh_instances.{host_id,epoch,heartbeat_at,lease_until};claimInstance 原子抢占
(UPDATE … WHERE host_id IS NULL OR lease_until < now)+ pinInstanceHost 钉住归属。
2) 租约与 fencing:src/supervisor/lease.ts(acquire/renew/release + stillHolder 判据 +
ttl > 2×renew 硬校验);心跳里续租,失权即向 worker 下发更高 epoch(self-fencing)。
⚠️ release 只清租约(lease_until),**保留 host_id** —— host_id 是「用户数据在哪台」的锚点。
3) Worker agent(src/worker/agent.ts,子命令 dshs worker):实例生命周期 + 文件面 /fs/*
+ 幂等键(operationId)+ 鉴权(timingSafeEqual);Worker 不写控制面数据
(apiKey/uid 由 Manager 随 launch 投递,R5 收窄)。
4) 远端 Spawner + LeasedSpawner:按 host 路由(**粘性优先**:有历史归属且那台 up 就留在原地,
否则按容量选最空的)+ 容量准入 + deployMode=cluster 装配(systemd drop-in,可回滚)。
5) bwrap 修正:**所有挂载点的中间目录统一前置 + 去重 + 由外到内**(「就近创建」会在嵌套前缀下
遮掉已绑挂载点 ⇒ bwrap: Can't chdir);且**只能用 --tmpfs**,用 --perms 会让 47 的
bwrap 0.4.0 直接拒启动(沙箱全挂)。
6) 跨机隧道 src/worker/tunnel.ts:SSH ControlMaster + 动态 -R 转发;**自愈由 agent 本地
20s 定时器驱动**(不能只放 /healthz —— 心跳本身经隧道进来,断了就没人触发它)。
7) 文件面按归属路由(RemoteUserFs):实例与文件必须落在同一台机器,否则实例看不到自己的文件。
8) 观测面:dshs doctor / dshs cluster status。
验证(本次均已实跑)
- test/lease.test.mjs:SQLite 10/10 == PG 10/10
- 组件级端到端 5 个:verify-cluster-{agent,lease,fs,migrate,live}.mjs
- 真跨机(47 Manager / 106 Worker,跨云 + 反向隧道)verify-cluster-cross.mjs 九步全绿
- 域名形态访问 verify-cluster-domain.mjs(<user>.域名 → Manager → 远端实例;越权 403)
- 冒烟 scripts/smoke-*:6/8,失败项与改动前基线完全相同(无回归)
- 生产切换与回滚剧本见 dsh-server-docs/交接单/T08-集群化落地-兼容单例模式.md §16
64 lines
2.6 KiB
JavaScript
64 lines
2.6 KiB
JavaScript
// Stand-in for a real `dsh` process used by the smoke tests. It is role-aware
|
||
// via DSHS_ROLE:
|
||
// - main: bind the loopback port and serve a marker page; /crash exits 1.
|
||
// - watchdog: headless; polls the handoff file and records what it "executes".
|
||
import { createServer } from 'node:http'
|
||
import { existsSync, readFileSync, writeFileSync } from 'node:fs'
|
||
import { dirname, join } from 'node:path'
|
||
|
||
const role = process.env.DSHS_ROLE ?? 'main'
|
||
const port = Number(process.env.DSHS_PORT ?? '3080')
|
||
const cwd = process.cwd()
|
||
|
||
if (role === 'watchdog') {
|
||
// One-shot watchdog: mark it ran, execute any handoff command, then exit.
|
||
const handoffPath = process.env.DSHS_HANDOFF_PATH
|
||
console.log(`fake-watchdog one-shot running cwd=${cwd}`)
|
||
if (handoffPath !== undefined) {
|
||
writeFileSync(join(dirname(handoffPath), 'watchdog-ran.json'), JSON.stringify({ at: Date.now() }))
|
||
}
|
||
setTimeout(() => {
|
||
let command = null
|
||
if (handoffPath !== undefined && existsSync(handoffPath)) {
|
||
const content = readFileSync(handoffPath, 'utf8').trim()
|
||
if (content !== '') {
|
||
try {
|
||
command = JSON.parse(content).command ?? content
|
||
} catch {
|
||
command = content
|
||
}
|
||
writeFileSync(join(dirname(handoffPath), 'watchdog-executed.json'), JSON.stringify({ command, at: Date.now() }))
|
||
writeFileSync(handoffPath, '')
|
||
}
|
||
}
|
||
console.log(`fake-watchdog done${command ? ` (executed: ${command})` : ''}`)
|
||
process.exit(0)
|
||
}, 300)
|
||
} else {
|
||
const server = createServer((req, res) => {
|
||
if (req.url === '/crash') {
|
||
res.writeHead(500, { 'content-type': 'text/plain' })
|
||
res.end('crashing')
|
||
setTimeout(() => process.exit(1), 10)
|
||
return
|
||
}
|
||
if (req.url === '/redirect') {
|
||
res.writeHead(302, { location: '/somewhere' })
|
||
res.end('redirecting')
|
||
return
|
||
}
|
||
res.writeHead(200, { 'content-type': 'text/plain' })
|
||
res.end(
|
||
`fake-dsh pid=${process.pid} port=${port} cwd=${cwd} url=${req.url} argv=${process.argv.slice(2).join(' ')}`,
|
||
)
|
||
})
|
||
server.listen(port, '127.0.0.1', () => {
|
||
console.log(`fake-dsh listening on ${port}`)
|
||
// 真实 dsh 启动后会打印**可直达的带 token URL**,平台就是靠这行取 launch token
|
||
// (正则:/dsh web: http://////127//.0//.0//.1://d+/////?token=([A-Za-z0-9_-]+)/)。
|
||
// 夹具必须照实吐出来,否则平台只能等满 10 s 超时 ⇒ 「登录直达会话」这条链路
|
||
// 在本机测试里**永远测不到**(2026-09-15 T08 S3 实测踩到)。
|
||
console.log(`dsh web: http://127.0.0.1:${port}/?token=FAKE_TOKEN_${process.pid}`)
|
||
})
|
||
}
|