shishengliang/lingniu-vehicle-ingest
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(go): expose fast writer batch pending metrics

Browse Source
This commit is contained in:
lingniu
2026-07-03 19:20:09 +08:00
parent 3b694671fa
commit c43b87d648
6 changed files with 93 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
docs/ops/go-vehicle-ingest-memory.md
View File

@@ -423,6 +423,15 @@ vehicle_fast_writer_stage_duration_ms_histogram_sum{subject,stage,status}
2026-07-03 后续优化：`nats-fast-writer` 已从“Fetch batch 后逐条写 TDengine”改为“Fetch batch 后先调用 `history.Writer.AppendAllBatch` 批量写 TDengine，再逐条更新 Redis 和 ack”。这样可以减少 TDengine round trip；Redis/ack 仍按单条执行，避免某条实时投影失败时误 ack。
同时新增 batch pending gauge：
```text
vehicle_fast_writer_batch_pending_messages
vehicle_fast_writer_batch_pending_envelopes
```
这两个指标表示 fast-writer 已拉取但尚未完成 TDengine/Redis/ack 的批内压力。带帧率压测时它们应在稳态接近 0，burst 后能够回落；如果持续非 0，需要结合 `vehicle_fast_writer_stage_duration_ms_histogram` 判断卡在 TDengine、Redis 还是 ack。
### NATS Kafka bridge batch 指标
2026-07-03 已为 NATS -> Kafka bridge 增加 batch pending 和 duration histogram：